Results for "testing"

Agent-native web and mobile end-to-end testing framework that executes natural-language goals and records verified actions for replay without further model calls. Apache-2.0 licensed.

Apache-2.0 corpus of 537 test cases and a TypeScript runner for benchmarking AI agent guardrail products, maintained by a vendor whose own product it scores.

Fully autonomous AI agent system for conducting ethical hacking and complex penetration testing tasks. MIT licensed.

Pure MLX runtime for the vision and audio towers of NVIDIA Nemotron 3 Nano Omni on Apple Silicon, tested for parity against NVIDIA's PyTorch reference. MIT licensed.

Open-source evaluation and testing library for LLM agents. Red teaming, vulnerability scanning, RAG evaluation, and safety testing with modular architecture. Apache 2.0 licensed.

ML & LLM monitoring framework.

Scalable and efficient data transformation framework with dbt compatibility. Features automatic data lineage, time travel, and virtual data environments for testing. Optimized for large-scale data warehouses. Apache 2.0 licensed.

Open-source LLM evaluation and red teaming framework. Test prompts, agents, and RAGs with automated security vulnerability scanning, side-by-side model comparison, and CI/CD integration. Now part of OpenAI. MIT licensed.

Comprehensive suite for LLM-based AI app development from prototyping to production. Includes prompt engineering, evaluation, and deployment tools with VS Code integration. MIT licensed.

AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows. MIT licensed.

Autonomous penetration testing agent utilizing Model Context Protocol (MCP) toolchains, blackboard state space search, and structured reasoning.

Multi-specialist agent skills framework for Claude Code and coding agents that structures development workflows into planning, design, QA, and release phases. MIT licensed.

Composable skills framework and software development methodology for coding agents, structuring processes like planning, test-driven development, and code review.

Curated set of skills, custom agents, and plugins to assist AI coding agents with .NET and C# development. MIT licensed.

Transform data using software engineering best practices. The industry-standard framework for analytics engineering with 15M+ monthly downloads. Enables version control, testing, and documentation for SQL transformations. Apache 2.0 licensed.

Pipeline to distill books, videos, and podcasts into structured, executable agent skills using verification and testing workflows. MIT licensed.

AI prompt optimization tool with multi-round iterative improvements, dual-mode optimization for system and user prompts, and multi-model support. Available as web app, desktop app, Chrome extension, and Docker deployment. AGPL-3.0 licensed.

Operating system for robotics. Currently upgrades driver assistance systems on 300+ supported cars. End-to-end autonomous driving stack with open-source hardware and software. MIT licensed.

AI-powered agentic red team framework that automates offensive security operations from reconnaissance to exploitation to post-exploitation with zero human intervention. Integrates multiple security tools for comprehensive penetration testing. MIT licensed.

Production-grade engineering skills and quality gates for AI coding agents, packaging developer workflows like spec refinement, planning, and testing.

Model Context Protocol (MCP) server bridging AI assistants with the Unity Editor to automate asset, scene, and script workflows. MIT licensed.

Data version control for your data lake that transforms object storage into Git-like repositories. Enables atomic, versioned data lake operations with branching, committing, and merging for data pipelines. Apache 2.0 licensed.

Local structural code search, caller navigation, impact analysis, and entity-level diffs exposed to coding agents through a CLI and MCP server. Apache-2.0 licensed.

The "Pytest for LLMs".