neww's picture

3 3

neww

newwspite

·

AI & ML interests

None yet

Recent Activity

reacted to BlinkDL's post with 👍 12 days ago

RWKV-7 "Goose" 0.4B trained w/ ctx4k automatically extrapolates to ctx32k+, and perfectly solves NIAH ctx16k 🤯 100% RNN and attention-free. Only trained on the Pile. No finetuning. Replicable training runs. tested by our community: https://github.com/Jellyfish042/LongMamba

reacted to BlinkDL's post with 🔥 12 days ago

RWKV-7 "Goose" 0.4B trained w/ ctx4k automatically extrapolates to ctx32k+, and perfectly solves NIAH ctx16k 🤯 100% RNN and attention-free. Only trained on the Pile. No finetuning. Replicable training runs. tested by our community: https://github.com/Jellyfish042/LongMamba

liked a model 2 months ago

stabilityai/stablelm-2-12b-chat

View all activity

Organizations

None yet

newwspite's activity

No public activity