Hugging Face's logo

lapp0
/
distily_bench_gpt2_simple_objectives2

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Metrics Community
lapp0 commited on
Commit
e3f2787
•
1 Parent(s): 902d4d0

Training in progress, step 24750

Browse files
Files changed (5) hide show
  1. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_cosine_distance_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_los/events.out.tfevents.1723548190.93d6cbb3ad53 +3 -0
  2. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_cross_entropy())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_fn_(f/events.out.tfevents.1723547906.93d6cbb3ad53 +2 -2
  3. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_sinkhorn_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_fn_(f/events.out.tfevents.1723548081.93d6cbb3ad53 +3 -0
  4. model.safetensors +1 -1
  5. training_args.bin +1 -1
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_cosine_distance_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_los/events.out.tfevents.1723548190.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c762f82a00b9ed2ae7706afc1891e98ee88d5ae3adba23c20524ca4c0db122a6
3
+ size 7100759
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_cross_entropy())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_fn_(f/events.out.tfevents.1723547906.93d6cbb3ad53 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:487a72c710a5a13d4fefd637dba1139b09acda4af1bd4f2721e81da5f6ecb40f
3
- size 253
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc5d6060526a56ba512dce7ffbdbaf6d84b3c0550eb376417bf6798ac341c592
3
+ size 529
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_sinkhorn_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_fn_(f/events.out.tfevents.1723548081.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31045124c597968c42d903d161aee2b8fcb3cfe0b72cc60d02fa7bdcc8656f11
3
+ size 6161
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f6ff7f4852ffc184340c7ec71482b1d02a2ca7f93df3ba1f44dac6db0976fe42
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64990a12aff0e0d0573ca480203aa7e395032969240f60d5a6981499fc8d28f3
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:26b9ff914ec90fe1ec21e725923d6a7f69a03b7da6b878bdf796c53fcbf617f4
3
  size 907106756
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f50e2b36145dd7937b47595429d071e9ecd0763fb1e4831a5aadb5e7101001bd
3
  size 907106756