AI & Machine Learning

RWKV Architecture

RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI project. Production at Windows, Office, NeMo. RWKV-7 (March 2025). Models up to 14B parameters.

Publisher / source

Orchestra-Research/AI-Research-SKILLs (found on skills.sh, an awesome list)

Upstream record

Orchestra-Research/AI-Research-SKILLs

Version

Version 3

Published

2026-11-02

Publication review

Approved for publication

Content fingerprint

17fc974b3f3b67b1648c5cb93b3bdc557fbd64df8463d8fbc8f71bdf88575a7c