Local ai | npm.io

Libraries and server to build AI applications. Adapters to various native bindings allowing local inference. Integrate it with your application, or use as a microservice.

local ai inference server model pool gpt4all node-llama-cpp transformers.js llama.cpp chatbot bot llm

1.0.0-beta.31 • Published 11 months ago

Libraries and server to build AI applications. Adapters to various native bindings allowing local inference. Integrate it with your application, or use as a microservice.

local ai inference server model pool gpt4all node-llama-cpp transformers.js llama.cpp chatbot bot llm

1.0.0-beta.19 • Published 1 year ago

Offload is an in-browser AI stack. It provides an SDK to run AI inference directly on your users' devices, increasing their data privacy and saving on inference costs.

ai webgpu local ai edge ai privacy local llm

1.2.1 • Published 1 year ago

Local ai Packages

inference-server

lllms

offload-ai