Llama.cpp | npm.io

llama.cpp gguf file parser for javascript

llama llama.cpp llama-cpp llamacpp llm gguf parser machine learning ml

0.2.2 • Published 13 days ago

use `npm i --save llama.native.js` to run lama.cpp models on your local machine. features a socket.io server and client that can do inference with the host of the model.

llm wrapper huggingface javascript llama.cpp socket.io dalai quantized cpu text

1.1.0 • Published 11 months ago

React Native binding of llama.cpp

react-native ios android large language model LLM Local LLM llama.cpp llama llama-2

0.3.0 • Published 7 days ago

serve websocket GGML 4/5bit Quantized LLM's based on Meta's LLaMa model with llama.ccp

llm wrapper huggingface javascript llama.cpp socket.io dalai quantized cpu text

0.1.0 • Published 11 months ago

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf

2.8.10 • Published 5 days ago

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

similique id llama.cpp bindings ai sequi blanditiis error llm laboriosam

1.3.1 • Published 29 days ago

Control what LLMs can, and can't, say

llm llama.cpp transformers.js llamafile llamacpp transformersjs gbnf grammar

0.0.11 • Published 14 days ago

<a href="https://www.npmjs.com/package/contort"><img alt="Latest Contortionist NPM Version" src="https://badge.fury.io/js/contort.svg" /></a> <a href="https://github.com/thekevinscott/contortionist/blob/master/LICENSE"><img alt="License for contortionist"

llm llama.cpp transformers.js llamafile llamacpp transformersjs gbnf grammar

0.0.8 • Published 29 days ago

A library for generating syntactically valid code from an LLM.

llm code-generation sql json llama.cpp transformers.js llamafile gbnf grammar

0.0.1 • Published 6 days ago

Llama.cpp Packages

hyllama

llama.native.js

llama.rn

llama-ggml.js

node-llama-cpp

quiad

contort

contortionist

autogrammer