npm.io

Nerdstash Packages

nai-js-tokenizer

BPE tokenizer used for the NovelAI frontend.

gpt gpt2 pile sentencepiece nerdstash tokenizer novelai

1.1.0 • Published 1 year ago

contact@npm.io