clearml/clearml
Open-source platform for experiment tracking, orchestration, data management, and model serving.
vllm-project/vllm
State-of-the-art serving engine with PagedAttention and continuous batching. Currently the fastest production-grade LLM server.
archestack/best-of-ai
Ranked list of open-source AI apps, agents, model servers and infrastructure tools, each scored from public GitHub data with written strengths and weaknesses and refreshed twice a day. MIT licensed.