OpenEvals

Open-source evaluation library for LLM and agent applications. Built by LangChain with pre-built evaluators for common use cases including RAG, agents, and structured output validation. MIT licensed.

View on GitHub Unknown

Guide pending

We haven't written this guide yet.

Guides are drafted from the project's own README and metadata. Until one exists, check the product's repository and documentation for authoritative information.

Nearby on the map

Related projects

DeepEval

confident-ai/deepeval

The "Pytest for LLMs".

unknown unknownactivity unknown

iFixAi

ifixai-ai/iFixAi

Agent-auditing framework that runs adversarial and operational inspections against AI agents, producing scored JSON and Markdown reports for CLI, CI, and agent-plugin workflows. Apache-2.0 licensed.

unknown unknownactivity unknown

Inspect AI

UKGovernmentBEIS/inspect_ai

Framework for large language model evaluations from the UK AI Security Institute.

unknown unknownactivity unknown

Lighteval

huggingface/lighteval

Evaluation toolkit for LLMs across multiple backends with reusable tasks, metrics, and result tracking.

unknown unknownactivity unknown

Hugging Face Evaluate

huggingface/evaluate

Standardized evaluation metrics.

unknown unknownactivity unknown

LMMs-Eval

EvolvingLMMs-Lab/lmms-eval

Unified multimodal evaluation toolkit for text, image, video, and audio tasks with 100+ supported benchmarks.

unknown unknownactivity unknown