03 / Inference Engines & Serving

Quantization, Distillation & Optimization

2 projects catalogued in this category.

LicenseLanguageActivityMin starsSort

2 projects

bitsandbytes

bitsandbytes-foundation/bitsandbytes

8-bit and 4-bit optimizers + quantization.

unknown unknownactivity unknown

Optimum

huggingface/optimum

Hardware-specific acceleration and quantization.

unknown unknownactivity unknown