0.3.1 • Published 1 year ago
@foundation0/tokenizers v0.3.1
Conductor Tokenizer Library
A common library of tokenizers for Conductor
Setup
Run generate script to download tokenizers and generate tokenizers/index.
bun run generateA common library of tokenizers for Conductor
Run generate script to download tokenizers and generate tokenizers/index.
bun run generate