Software Development

Convert Quantize

Use this skill when the user wants to convert a Hugging Face model to MLX or quantize/dequantize one with mlx_vlm.convert, including bits and group size, quant modes (affine, mxfp4, nvfp4, mxfp8), RTN vs AWQ, mixed-bit recipes, dtype casts, calibration (text or multimodal), local vs Hub paths, revisions, uploading to the Hub, and convert/quant errors.

Publisher / source
Blaizzy/mlx-vlm (found on GitHub top repositories)
Upstream record
Blaizzy/mlx-vlm
Version
Version 1
Published
Publication review
Approved for publication
Content fingerprint
1937024f1de38dee3aad8fdc99aa34260ebfd265f08d43319d554f41a5e0da6e