Hugging Face model: nlproj/lact_100M_r8_bs256_lr3e-4_steps5000
Author: nlproj
Created: 2026-05-08 23:49:27
Last modified: 2026-05-08 23:49:37
Likes: 0 | Downloads: 6
Tags: safetensors, lact_swiglu, low-rank-fast-weights, linear-attention, lact, r8, 100M, dataset:HuggingFaceFW/fineweb-edu, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
tags: low-rank-fast-weights, linear-attention, lact, r8, 100M
datasets: HuggingFaceFW/fineweb-edu