Bpe | npm.io

Fast and versatile tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization

0.10.1 • Published 11 months ago

n8n node for working with BPE Tokens with OpenAI's GPT models in mind.

0.1.1 • Published 2 years ago

GPT Turbo plugin that calculates your conversation size and cost

5.0.1 • Published 2 years ago

TypeScript version of PGN Tokenizer, a Byte Pair Encoding (BPE) tokenizer for Chess Portable Game Notiation (PGN).

0.1.6 • Published 7 months ago

⏳ js-tiktoken on Cloudflare Pages

1.0.12 • Published 7 months ago

Bpe Packages