@huggingface/gguf
a GGUF parser that works on remotely hosted files
a GGUF parser that works on remotely hosted files
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
llama.cpp gguf file parser for javascript
Lightweight JavaScript package for running GGUF language models
Chat UI and Local API for the Llama models
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level