LLM Packages

Structured inference with LLaMa 2 in your browser

A collection of AI model specifications across different providers

Generate Vercel AI SDK tools from a OpenAPI specs.

A state machine orchestrator for AI agents with streaming support

An AI Registry

A library that lets you parse and interact with AI capabilities plugins according to Open AI's plugins specifications

A collection of AI model specifications across different providers

A framework for evaluating LLM results

A framework for connecting your data to large language models

A Model Context Protocol server built in TypeScript that leverages Neo4j’s graph database, delivers intelligent project and task management while empowering LLM agents with seamless collaboration and guidance.

Fetch streaming LLM responses as an async iterable

The Hugging Face LLM CDK Construct Library provides constructs to easily deploy a Hugging Face LLM model to Amazon SageMaker.

LLM-powered configuration handler for Express.js

CLI tool for syncing local files to Needle

CLI tool for syncing local files to Needle

A simple Astro plugin to make documentation LLM-ready by extracting plain text from docs.

A functional workflow and agent library for LLM applications

An intelligent codebase analyzer that creates AI-friendly documentation

ask llm models from openai hosted either on azure or openai

Interact with Apple Intelligence through JS