Inspect AI

Framework for large language model evaluations from the UK AI Security Institute.

Guide pending

We haven't written this guide yet.

Guides are drafted from the project's own README and metadata. Until one exists, check the product's repository and documentation for authoritative information.

Nearby on the map

Related projects

DeepEval

confident-ai/deepeval

The "Pytest for LLMs".

unknown unknownactivity unknown

iFixAi

ifixai-ai/iFixAi

Agent-auditing framework that runs adversarial and operational inspections against AI agents, producing scored JSON and Markdown reports for CLI, CI, and agent-plugin workflows. Apache-2.0 licensed.

unknown unknownactivity unknown

Lighteval

huggingface/lighteval

Evaluation toolkit for LLMs across multiple backends with reusable tasks, metrics, and result tracking.

unknown unknownactivity unknown

Hugging Face Evaluate

huggingface/evaluate

Standardized evaluation metrics.

unknown unknownactivity unknown

LMMs-Eval

EvolvingLMMs-Lab/lmms-eval

Unified multimodal evaluation toolkit for text, image, video, and audio tasks with 100+ supported benchmarks.

unknown unknownactivity unknown

BrowserGym

ServiceNow/BrowserGym

Gym environment for web task automation and agent evaluation. Includes MiniWoB, WebArena, WorkArena, and more. Apache 2.0 licensed.

unknown unknownactivity unknown