0.4.0 • Published 6 months ago

@retune.so/tokenizer v0.4.0

Weekly downloads
-
License
MIT
Repository
-
Last release
6 months ago

GPT-3-Encoder

GPT-3 Encoder/Decoder for Typescript based project

About

GPT-2 and GPT-3 use byte pair encoding to turn text into a series of integers to feed into the model. This is a javascript implementation of OpenAI's original python encoder/decoder which can be found here

0.4.0

6 months ago

0.3.0

6 months ago