Creative Design & Branding

Mamba Architecture

State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware design. Mamba-1 (d_state=16) and Mamba-2 (d_state=128, multi-head). Models 130M-2.8B on HuggingFace.

Publisher / source
Orchestra-Research/AI-Research-SKILLs (found on skills.sh, an awesome list)
Upstream record
Orchestra-Research/AI-Research-SKILLs
Version
Version 2
Published
Publication review
Approved for publication
Content fingerprint
51ddf99c12a472a78c258bddf7e66e72cf45d9e04969f3300cc8d68aaaef9b0e