turing.sh
A package to interact with the api from TuringAI (turing.sh) and access the most powerful AI models in the world.
A package to interact with the api from TuringAI (turing.sh) and access the most powerful AI models in the world.
Zero-dependency, modular SDK for building robust natural language applications
Our library `@lenml/llama2-tokenizer` has been deprecated. We are excited to introduce our new library `@lenml/tokenizers` as its replacement, offering a broader set of features and an enhanced experience.
internlm2 tokenizer for NodeJS/Browser
llama2 tokenizer for NodeJS/Browser
llama3 tokenizer for NodeJS/Browser
llama3_1 tokenizer for NodeJS/Browser
qwen1_5 tokenizer for NodeJS/Browser
text_davinci002 tokenizer for NodeJS/Browser
text_davinci003 tokenizer for NodeJS/Browser
text_embedding_ada002 tokenizer for NodeJS/Browser
yi tokenizer for NodeJS/Browser
a lightweight no-dependency fork of transformers.js (only tokenizers)
baichuan2 tokenizer for NodeJS/Browser