@lenml/tokenizer-claude1
claude1 tokenizer for NodeJS/Browser
3.4.2 • Published 1 year ago
Llama3 Packages
@lenml/tokenizer-command_r_plus
command_r_plus tokenizer for NodeJS/Browser
@lenml/tokenizer-deepseek_v3
deepseek_v3 tokenizer for NodeJS/Browser
@lenml/tokenizer-gemini
gemini tokenizer for NodeJS/Browser
@lenml/tokenizer-gemma
gemma tokenizer for NodeJS/Browser
@lenml/tokenizer-gemma2
gemma2 tokenizer for NodeJS/Browser
@lenml/tokenizer-gemma3
gemma3 tokenizer for NodeJS/Browser
@lenml/tokenizer-gpt2
gpt2 tokenizer for NodeJS/Browser
@lenml/tokenizer-gpt3
gpt3 tokenizer for NodeJS/Browser
@lenml/tokenizer-gpt35turbo
gpt35turbo tokenizer for NodeJS/Browser
@lenml/tokenizer-gpt35turbo16k
gpt35turbo16k tokenizer for NodeJS/Browser
@lenml/tokenizer-gpt4
gpt4 tokenizer for NodeJS/Browser
@lenml/tokenizer-gpt4o
gpt4o tokenizer for NodeJS/Browser
@lenml/tokenizer-internlm2
internlm2 tokenizer for NodeJS/Browser
@lenml/tokenizer-llama2
llama2 tokenizer for NodeJS/Browser
@lenml/tokenizer-llama3
llama3 tokenizer for NodeJS/Browser
@lenml/tokenizer-llama3_1
llama3_1 tokenizer for NodeJS/Browser
@f97/aicommit2
A Reactive CLI that generates git commit messages with various AI
@rajrajhans/ai-renamer
A Node.js CLI that uses Ollama and LM Studio models (Llava, Gemma, Llama etc.) to intelligently rename files by their contents