Hugging Face model: barpitf/RAT
Author: barpitf
Created: 2025-12-10 14:33:28
Last modified: 2025-12-11 14:24:59
Library: RAT
Likes: 2 | Downloads: 0
Tags: RAT, efficient architecture, recurrence, attention, pretraining, en, dataset:HuggingFaceFW/fineweb-edu, arxiv:2507.04416, license:mit, region:us
Card metadata:
library_name: RAT
language: en
license: mit
datasets: HuggingFaceFW/fineweb-edu
tags: efficient architecture, recurrence, attention, pretraining
metrics: perplexity, accuracy