iconically-mine
/

anlp-a2-shared_top1

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

shared_top1 transformer (ANLP A2, Task 1)

Parameters: 12.94M
ffn_type: shared_top1
d_model=256, n_layers=6, n_heads=8, ffn_hidden_dim=1024
Tokens trained on: 30.00M
Final val loss: 3.8748

Checkpoint: shared_top1_final.pt (load with torch.load, see src/part1/model/transformer.py).

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support