Evals Packages

Modular LLM orchestration framework

Umbrage Evals CLI

Model graded evals with typescript

Test your LLM-powered apps with a TypeScript-native, Vitest-based eval runner. No API key required.

Evals as an API - The easiest way to evaluate and benchmark AI models and systems

Test your LLM-powered apps with a TypeScript-native, Vitest-based eval runner. No API key required.

The core foundation of the Mastra framework, providing essential components and interfaces for building AI-powered applications.

Gentrace Evals plugin for Node.JS

The core foundation of the Mastra framework, providing essential components and interfaces for building AI-powered applications.

Langchain Integration for Hamming SDK

SDK for Hamming Evals Framework