A Controlled Study on Long Context Extension and Generalization in LLMs
Paper
•
2409.12181
•
Published
•
44
Junxiong Wang
JunxiongWang
AI & ML interests
Attention Free Model / Subquadratic Language Models
Recent Activity
updated
a dataset
3 days ago
JunxiongWang/model_revision_max_4_closest_and_random
updated
a model
4 days ago
togethercomputer/MambaInLlama1B
updated
a collection
16 days ago
Mamba-In-Zephyr
Organizations
JunxiongWang's activity
upvoted
2
papers
4 months ago