Gguf Packages

llama.cpp gguf file parser for javascript

Lightweight JavaScript package for running GGUF language models

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Various utilities for maintaining Ollama compatibility with models on Hugging Face hub

a GGUF parser that works on remotely hosted files

Native Node.JS plugin to run LLAMA inference directly on your machine with no other dependencies.

Chat UI and Local API for the Llama models

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level