AI & Machine Learning
Omh Model Compression
[omh] Making a model smaller or cheaper by changing its weights: quantization (GPTQ, AWQ, GGUF, bitsandbytes, FP8, quantization-aware training), pruning, or distillation into a smaller student, sized to the target hardware, calibrated on the task's own data, and kept only when it holds quality on the person's own eval. Use when the user says: model-compression, model compression, compress this model, compress the model, compress a model, compress our model, compress my model, quantize this model.
- Publisher / source
- rlaope/oh-my-hermes (found on GitHub top repositories)
- Upstream record
- rlaope/oh-my-hermes
- Version
- Version 1
- Published
- Publication review
- Approved for publication
- Content fingerprint
aa18fc7f6c76f2054040e02b7f79a0e7fafd7c514a6ae31e3e7ff9581d1604bf