Spaces:

nroggendorff
/

train-llama

Runtime error

nroggendorff commited on Sep 3, 2024

Commit

5d4d177

verified ·

1 Parent(s): 0716c74

Update train.py

Files changed (1) hide show

train.py CHANGED Viewed

@@ -131,6 +131,7 @@ def train_model(model, tokenizer, dataset, push, isinst):
         weight_decay=DECAY,
         gradient_accumulation_steps=GRADIENT_ACCUMULATION_STEPS,
         fp16=FP16,
         logging_steps=10
     )

         weight_decay=DECAY,
         gradient_accumulation_steps=GRADIENT_ACCUMULATION_STEPS,
         fp16=FP16,
+        save_steps=int(1e+10),
         logging_steps=10
     )