Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
lapp0
/
distily_bench_gpt2_attn
like
0
TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
License:
mit
Model card
Files
Files and versions
Metrics
Training metrics
Community
32685dd
distily_bench_gpt2_attn
/
logs
1 contributor
History:
9 commits
This model has 1 file scanned as unsafe.
Show
files
lapp0
End of training
32685dd
verified
3 months ago
attn_loss_fn=cos, attn_weight=2.0
Training in progress, step 12375
3 months ago
attn_loss_fn=jsd, attn_weight=2.0
End of training
3 months ago
attn_loss_fn=kl, attn_weight=2.0
Training in progress, step 12375
3 months ago
attn_loss_fn=mse, attn_weight=2.0
Training in progress, step 12375
3 months ago
attn_loss_fn=mse_sum, attn_weight=2.0
Training in progress, step 12375
3 months ago
events.out.tfevents.1723651220.93d6cbb3ad53
Safe
5.91 kB
LFS
Training in progress, step 12375
3 months ago
events.out.tfevents.1723651454.93d6cbb3ad53
Safe
5.91 kB
LFS
Training in progress, step 12375
3 months ago
events.out.tfevents.1723651737.93d6cbb3ad53
Safe
196 kB
LFS
Training in progress, step 12375
3 months ago
events.out.tfevents.1723652161.93d6cbb3ad53
Safe
5.91 kB
LFS
Training in progress, step 12375
3 months ago
events.out.tfevents.1723652404.93d6cbb3ad53
Safe
3.35 MB
LFS
Training in progress, step 12375
3 months ago
events.out.tfevents.1723656174.93d6cbb3ad53
Safe
520 Bytes
LFS
Training in progress, step 12375
3 months ago
