Llama-cpp | npm.io

llama.cpp gguf file parser for javascript

llama llama.cpp llama-cpp llamacpp llm gguf parser machine learning ml

0.2.2 • Published 2 years ago

A simple, unified NPM-based interface for interacting with multiple Large Language Model (LLM) APIs, including OpenAI, AI21 Studio, Anthropic, Cloudflare AI, Cohere, Fireworks AI, Google Gemini, Goose AI, Groq, Hugging Face, Mistral AI, Perplexity, Reka A

ai21-studio ai21 ailayer aimlapi anyscale anthropic microsoft-azure-ai cloudflare-ai cohere corcel

2.0.1495 • Published 1 year ago

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf

1.5.0 • Published 4 months ago

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf

3.6.0 • Published 8 months ago

Chat UI and Local API for the Llama models

llama llama-cpp bindings ai prebuilt-binaries llm gguf raspberry-pi self-hosted node-llama-cpp

3.2.2 • Published 1 year ago

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level