RWKV-X Collection RWKV-X is a family of long-context models based on RWKV-7, enhanced with Sparse Attention and capable of handling context windows up to 64K tokens. • 1 item • Updated 6 days ago
RWKV-7 "Goose" with Expressive Dynamic State Evolution Paper • 2503.14456 • Published 28 days ago • 137 • 11
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence Paper • 2404.05892 • Published Apr 8, 2024 • 39
RWKV-7 "Goose" with Expressive Dynamic State Evolution Paper • 2503.14456 • Published 28 days ago • 137
RWKV-7 "Goose" with Expressive Dynamic State Evolution Paper • 2503.14456 • Published 28 days ago • 137