Hugging Face's logo

distily
/
distily_smollm_dataset_sweep

TensorBoard
Safetensors
Distily
llama
Generated from Trainer
Model card Files Metrics Community
lapp0 commited on
Commit
e9792fe
•
1 Parent(s): 8c75dc8

Training in progress, step 5000

Browse files
Files changed (5) hide show
  1. logs/dataset_max_seq_length=1024, dataset_sample_size=1000000, dataset_subset=sample-10BT, dataset_uri=HuggingFaceFW_fineweb, learning_rate=6e-05, per_device_train_batch_size=8/events.out.tfevents.1727271454.1c1a426a2fee +3 -0
  2. logs/dataset_max_seq_length=1024, dataset_sample_size=1000000, dataset_subset=sample-10BT, dataset_uri=HuggingFaceFW_fineweb, logits_loss_fn=liger_kl, per_device_train_batch_size=8/events.out.tfevents.1727266615.1c1a426a2fee +2 -2
  3. logs/dataset_max_seq_length=1024, dataset_sample_size=1000000, dataset_subset=sample-10BT, dataset_uri=HuggingFaceFW_fineweb, logits_loss_fn=liger_kl, per_device_train_batch_size=8/events.out.tfevents.1727268460.1c1a426a2fee +3 -0
  4. model.safetensors +1 -1
  5. training_args.bin +1 -1
logs/dataset_max_seq_length=1024, dataset_sample_size=1000000, dataset_subset=sample-10BT, dataset_uri=HuggingFaceFW_fineweb, learning_rate=6e-05, per_device_train_batch_size=8/events.out.tfevents.1727271454.1c1a426a2fee ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed3b5fa263d71c6ce8b7b3dd76ad1f58c0e70ec69c93430eacf061b8e204411c
3
+ size 140500
logs/dataset_max_seq_length=1024, dataset_sample_size=1000000, dataset_subset=sample-10BT, dataset_uri=HuggingFaceFW_fineweb, logits_loss_fn=liger_kl, per_device_train_batch_size=8/events.out.tfevents.1727266615.1c1a426a2fee CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c8ab459c4ea00bf0ec54305b6a79e68860447099ff56f1567e28f6fdb6ee8b97
3
- size 140780
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bdd7c58139e520fecdbcd7e5ffcfd6349d511e476c02526397be989356308fc
3
+ size 164916
logs/dataset_max_seq_length=1024, dataset_sample_size=1000000, dataset_subset=sample-10BT, dataset_uri=HuggingFaceFW_fineweb, logits_loss_fn=liger_kl, per_device_train_batch_size=8/events.out.tfevents.1727268460.1c1a426a2fee ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5773bbb0c93b9c4731e58c54052146fa99efca989a90313ca6a9ec4b97bdd791
3
+ size 31257
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5c6b543d0b2210018ba972399f2834c98acd00db5b0ac8d279cb6de7641fa2b1
3
  size 325669528
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f81c53c2237e248599fffdb20c9b3c1d0e7ef8d7efdf3de90b83c3697b94226b
3
  size 325669528
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:489ac1c599f8c23dd19af80387679fc021366579b87b8a776b5ebb68da3da2a3
3
  size 5688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b064995b3b0c85b7e6f03ec07bd80ff37ab94e4235f229ba4f4b596e5e5b8f3b
3
  size 5688