Web Data Ingestion

LLM-friendly web crawler that turns websites into clean Markdown for RAG and agentic workflows.

Adaptive web scraping and crawling framework for robust structured extraction from pages to large-scale pipelines.

Machine-first headless browser in Zig; rendering-free and ultra-lightweight for AI agent browsing.

Automated document analyzer for Paperless-ngx with RAG-powered semantic search across your document archive.

Web Data API for AI - search, scrape, and interact with the web at scale. Clean markdown/JSON output with proxy rotation and JS-blocking handled automatically.

Local-first web intelligence and Model Context Protocol (MCP) server for web search, crawling, and structured data extraction. AGPL-3.0 licensed.

MCP search and evidence tool for AI agents with query rewriting, source zoom-in, sourced answers, and runtime metrics. MIT licensed.

Playwright wrapper for a stealth-patched Firefox 150 binary. Drop-in Browser object for AI agents that need to ingest web data from sites with anti-bot guardrails (reCAPTCHA, FingerprintPro, Cloudflare). Spoofing happens in C++ source, not via JS overrides. MIT (wrapper) + MPL-2.0 (patches).