Hugging Face's logo

lapp0
/
distily_bench_gpt2_simple_objectives2

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Metrics Community
lapp0 commited on
Commit
1adbb7d
•
1 Parent(s): 7386ecd

Training in progress, step 24750

Browse files
Files changed (4) hide show
  1. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_cakld_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_fn_(fn_s/events.out.tfevents.1723518645.93d6cbb3ad53 +3 -0
  2. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_reverse_kl_divergence_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentio/events.out.tfevents.1723518474.93d6cbb3ad53 +2 -2
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_cakld_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_fn_(fn_s/events.out.tfevents.1723518645.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:628420dc9e4e5e92226bdc35286f9edd313c7c346f1b375523e5180db946da9e
3
+ size 5607523
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_reverse_kl_divergence_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentio/events.out.tfevents.1723518474.93d6cbb3ad53 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cbc91cb832d79a85628ad731d9c300628a6c3e0420a225fcd7ee62a199e7a953
3
- size 253
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5be5147fded70d41cafdc5d2b59638a8a55b191e957390a2bfc39fcf6164c12
3
+ size 529
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:af3ac92285d1874dae3832b31df768cf9490f955bd8576d1d809c6cf8d1966ec
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac36b967761a46a4f37250f26ecf19b6f549853a3edee5398faa95f95214c780
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f2d3f8be3b0849e60525b6afc29b38f1eda41223786751743be2c49bf1f83890
3
  size 907106756
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1fcdd655df474200be0960829bf7a85acc9142e563137cef69fd45945303a41
3
  size 907106756