handy-computer/transcribe.cpp
C/C++ speech-to-text inference library running 16+ model families on the ggml runtime with GPU acceleration.
moonshine-ai/moonshine
Open-source on-device voice AI toolkit for low-latency speech-to-text, intent recognition, and text-to-speech.
geeks-accelerator/ollama-herd
Self-hosted router that spreads LLM, embedding, image and speech-to-text requests across machines running Ollama or mlx_lm.server, choosing a node per request by memory fit, thermal state, queue depth and loaded models. MIT licensed.
mozilla-ai/llamafile
Mozilla's single-file distributable LLM solution. Bundle model weights, inference engine, and runtime into one portable executable that runs on six OSes without installation.
collabora/WhisperLive
Nearly-live implementation of OpenAI's Whisper for real-time speech-to-text transcription. Supports faster-whisper, tensorrt, and openvino backends with WebSocket streaming. MIT licensed.
pipecat-ai/pipecat
Open-source framework for voice and multimodal conversational AI. Build real-time voice agents with support for speech-to-text, LLMs, text-to-speech, and live video. BSD-2-Clause licensed.
openai/whisper
Canonical open speech-to-text model codebase with widespread ecosystem support and many downstream implementations.
cjpais/Handy
Cross-platform local speech-to-text app that uses Whisper or Parakeet with voice-activity detection, then pastes the transcription into the active application. MIT licensed.
duct-tape2/ai-language-partner
Local-first Expo and FastAPI Japanese practice app for Korean speakers that uses Whisper-compatible STT, local TTS, and embedding-based dialogue matching without a runtime LLM.
off-grid-ai/OGAD
Local-first macOS AI app that runs LLM chat, image generation, voice transcription, and personal memory/RAG fully on-device via llama.cpp - nothing leaves the machine. AGPL-3.0 licensed.
PersonalJarvis/PersonalJarvis
Desktop voice and chat assistant for Windows, macOS, and Linux with a custom wake phrase, local speech-to-text, and a workspace that runs CLI coding agents side by side in terminal panes, working with any single model provider key or local models via Ollama. Apache-2.0 licensed.
huggingface/speech-to-speech
Low-latency, fully modular voice-agent pipeline integrating voice activity detection, speech-to-text, LLMs, and text-to-speech via an OpenAI Realtime-compatible WebSocket API. Apache 2.0 licensed.
cactus-compute/needle
Compact 45M-parameter foundation model and 14MB inference engine for tool calling and structured extraction on tiny devices. MIT licensed.
HeyWillow/willow
Open source, local, and self-hosted Amazon Echo/Google Home competitive voice assistant alternative with hardware support. Apache-2.0 licensed.
apoorvdarshan/scowld
Native iOS AI voice companion with an animated VRM character, voice and text chat, local conversation history, optional camera context, and BYOK AI, speech-to-text, and text-to-speech providers. MIT licensed.
Starmel/OpenSuperWhisper
macOS dictation application providing real-time audio transcription and drag-and-drop file transcription using Whisper and Parakeet models. MIT licensed.
quietbin/voz-mac
macOS dictation app that types transcribed speech at the cursor in any application, with whisper.cpp and the Whisper model bundled so it runs offline with no setup. Also records meetings on-device and generates summaries through a bundled llama.cpp. GPL-3.0 licensed.
OpenNMT/CTranslate2
Fast inference engine for Transformer models supporting OpenNMT and Hugging Face models. Optimized for CPU and GPU with batching, quantization (INT8/FP16), and dynamic memory management. Powers faster-whisper and other production deployments. MIT licensed.
livekit/agents
Framework for building realtime voice AI agents with WebRTC transport, STT-LLM-TTS pipelines, and production-grade orchestration. Used by Salesforce Agentforce and Tesla. Apache-2.0 licensed.
hwdsl2/self-hosted-ai-stack
MIT-licensed Docker Compose stack for private AI with Ollama, a LiteLLM gateway, chat/RAG, voice, and MCP tooling.
microsoft/Foundry-Local
Open-source on-device AI platform covering discovery, model running, sandboxed execution, and evaluation of open models.
VoltAgent/voltagent
TypeScript-first AI agent engineering platform with memory, RAG, workflows, MCP integration, and voice support.
openai/openai-agents-python
Production-ready lightweight framework for multi-agent workflows. The evolution of Swarm with enhanced orchestration capabilities and enterprise-grade features.
Panniantong/Agent-Reach
Reusable search and web-ingestion layer for AI agents spanning Reddit, X/Twitter, YouTube, GitHub, Bilibili and more through one CLI.