AI & Machine Learning

Model Quantizer

Reduces LLM memory usage by 50-75% through 8-bit or 4-bit quantization for efficient inference.

Publisher / source
Orchestra-Research/AI-Research-SKILLs (found on skills.sh, an awesome list)
Upstream record
Orchestra-Research/AI-Research-SKILLs
Version
Version 3
Published
Publication review
Approved for publication
Content fingerprint
0a68e96c760b0ba561437328211a8405b4db422e9bad92415219abf91f87f849