Node-llama-cpp

Libraries and server to build AI applications. Adapters to various native bindings allowing local inference. Integrate it with your application, or use as a microservice.

local ai inference server model pool gpt4all node-llama-cpp transformers.js llama.cpp chatbot bot llm

1.0.0-beta.31 • Published 4 months ago

Libraries and server to build AI applications. Adapters to various native bindings allowing local inference. Integrate it with your application, or use as a microservice.

local ai inference server model pool gpt4all node-llama-cpp transformers.js llama.cpp chatbot bot llm

1.0.0-beta.19 • Published 8 months ago

Chat UI and Local API for the Llama models

llama llama-cpp bindings ai prebuilt-binaries llm gguf raspberry-pi self-hosted node-llama-cpp

3.2.2 • Published 12 months ago

Node-llama-cpp Packages

inference-server

lllms

catai