DevOps & Infrastructure
Hqq Quantization
Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets, for fast quantization workflows, or when deploying with vLLM or HuggingFace Transformers.
- Publisher / source
- Orchestra-Research/AI-Research-SKILLs (found on skills.sh, an awesome list)
- Upstream record
- Orchestra-Research/AI-Research-SKILLs
- Version
- Version 2
- Published
- Publication review
- Approved for publication
- Content fingerprint
4feba64227f6db505044663cd5432bf9c0599c5c8984d94d3b2d1598711a1f80