Detoxify

Trained models and code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using PyTorch Lightning and Transformers for toxicity, severe toxicity, obscene, threat, insult, identity attack, and sexual explicit content detection. Apache 2.0 licensed.

View on GitHub Unknown

Guide pending

We haven't written this guide yet.

Guides are drafted from the project's own README and metadata. Until one exists, check the product's repository and documentation for authoritative information.

Nearby on the map

Related projects

PyRIT (Microsoft)

microsoft/PyRIT

Python Risk Identification Tool for generative AI. Microsoft's open-source framework for automated red teaming with multi-modal attack support, crescendo strategies, and 100+ operations experience. MIT licensed.

unknown unknownactivity unknown

Heretic

p-e-w/heretic

Open-source system for automatic censorship and robustness suppression removal in language-model outputs.

unknown unknownactivity unknown

Agentic Security

msoedov/agentic_security

Agentic LLM vulnerability scanner and AI red teaming kit with multi-step attack simulation and automated security probing. Apache 2.0 licensed.

unknown unknownactivity unknown

NeMo Guardrails (NVIDIA)

NVIDIA-NeMo/Guardrails

Programmable guardrails toolkit for LLM-based conversational systems. Uses Colang DSL to define safety rules, dialog flows, and content boundaries. Integrates with LangChain, LangGraph, and LlamaIndex for production deployments. Apache 2.0 licensed.

unknown unknownactivity unknown

Guardrails AI

guardrails-ai/guardrails

Input/output validation framework for building reliable AI applications. Detects and mitigates risks through composable validators for PII, toxicity, prompt injection, and structured output validation. Features Guardrails Hub with 50+ pre-built validators. Apache 2.0 licensed.

unknown unknownactivity unknown

RedAmon

samugit83/redamon

AI-powered agentic red team framework that automates offensive security operations from reconnaissance to exploitation to post-exploitation with zero human intervention. Integrates multiple security tools for comprehensive penetration testing. MIT licensed.

unknown unknownactivity unknown