MNN

Blazing-fast, lightweight inference engine battle-tested by Alibaba. Supports inference and training with industry-leading on-device performance. Powers high-performance LLMs and Edge AI with MNN-LLM runtime. Apache 2.0 licensed.

View on GitHub Unknown

Guide pending

We haven't written this guide yet.

Guides are drafted from the project's own README and metadata. Until one exists, check the product's repository and documentation for authoritative information.

Nearby on the map

Related projects

ExecuTorch

pytorch/executorch

PyTorch runtime and toolchain for deploying AI models on mobile, embedded, and edge devices.

unknown unknownactivity unknown

OpenVINO

openvinotoolkit/openvino

Intel's toolkit for edge deployment.

unknown unknownactivity unknown

Apache TVM

apache/tvm

Open Machine Learning Compiler Framework. Universal deployment to bring models into minimum deployable modules that can be embedded and run everywhere from datacenter to edge devices. Apache 2.0 licensed.

unknown unknownactivity unknown

NCNN

Tencent/ncnn

High-performance neural network inference framework optimized for mobile platforms. No third-party dependencies, cross-platform, and runs faster than all known open-source frameworks on mobile CPU. Powers Tencent apps including QQ, WeChat, and Pitu. BSD-3-Clause licensed.

unknown unknownactivity unknown

RuView

ruvnet/RuView

Real-time spatial intelligence, vital sign monitoring, and human pose estimation using commodity WiFi signals and neural networks. MIT licensed.

unknown unknownactivity unknown