NVIDIA Model Optimizer
Unified library of SOTA model optimization techniques including quantization, pruning, distillation, and speculative decoding. Compresses deep learning models for deployment with TensorRT-LLM, TensorRT, and vLLM to optimize inference speed across NVIDIA hardware.
View on GitHub Unknown
Guide pending
We haven't written this guide yet.
Guides are drafted from the project's own README and metadata. Until one exists, check the product's repository and documentation for authoritative information.
Nearby on the map