Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
lapp0
/
distily_bench_gpt2_attn
like
0
TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
License:
mit
Model card
Files
Files and versions
Metrics
Training metrics
Community
32685dd
distily_bench_gpt2_attn
/
logs
/
attn_loss_fn=kl, attn_weight=2.0
/
events.out.tfevents.1723668499.93d6cbb3ad53
Commit History
Training in progress, step 12375
4b194f3
verified
lapp0
commited on
Aug 14
End of training
726221e
verified
lapp0
commited on
Aug 14