npm.io
0.1.1 • Published yesterday

tokenizer-core

Licence
MIT
Version
0.1.1
Deps
2
Size
18 kB
Vulns
0
Weekly
0
SummaryDependencyVersions
Dependencies
js-tiktoken@huggingface/tokenizers