AI & Machine Learning
Model Quantizer
Reduces LLM memory usage by 50-75% through 8-bit or 4-bit quantization for efficient inference.
- Publisher / source
- Orchestra-Research/AI-Research-SKILLs (found on skills.sh, an awesome list)
- Upstream record
- Orchestra-Research/AI-Research-SKILLs
- Version
- Version 3
- Published
- Publication review
- Approved for publication
- Content fingerprint
0a68e96c760b0ba561437328211a8405b4db422e9bad92415219abf91f87f849