sanchit-gandhi's picture
Training in progress, step 500
998e66d
raw
history blame contribute delete
No virus
6.2 kB
wandb: WARNING Config item 'output_dir' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'evaluation_strategy' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'per_device_train_batch_size' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'per_device_eval_batch_size' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'gradient_accumulation_steps' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'learning_rate' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'num_train_epochs' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'warmup_steps' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'logging_steps' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'save_steps' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'eval_steps' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'metric_for_best_model' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'greater_is_better' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'generation_max_length' was locked by 'sweep' (ignored update).
wandb: WARNING Config item 'generation_num_beams' was locked by 'sweep' (ignored update).
0%| | 0/9720 [00:00<?, ?it/s]
Training completed. Do not forget to share your model on huggingface.co/models =)
Loading best model from ./checkpoint-1500 (score: 1.89534922643667e-13).
{'train_runtime': 8.0061, 'train_samples_per_second': 77706.136, 'train_steps_per_second': 1214.076, 'train_loss': 0.0, 'epoch': 3.0}
0%| | 0/9720 [00:04<?, ?it/s]
Skipping the first batches: : 0it [00:08, ?it/s] | 0/9720 [00:04<?, ?it/s]
Saving model checkpoint to ./
Configuration saved in ./config.json
Model weights saved in ./pytorch_model.bin
Feature extractor saved in ./preprocessor_config.json
Saving model checkpoint to ./
Configuration saved in ./config.json
Model weights saved in ./pytorch_model.bin
Feature extractor saved in ./preprocessor_config.json
Upload file runs/May05_17-05-42_sanchit--v100/events.out.tfevents.1651770393.sanchit--v100.71806.0: 100%|β–ˆ| 9.97k/9.97k
Upload file runs/May05_17-05-42_sanchit--v100/1651770393.8000064/events.out.tfevents.1651770393.sanchit--v100.71806.1: 1
Upload file training_args.bin: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 3.17k/3.17k [00:00<?, ?B/s]
05/05/2022 17:07:33 - WARNING - huggingface_hub.repository - To https://huggingface.co/sanchit-gandhi/xtreme_s_xlsr_2_bart_covost2_fr_en_2
4513ac8..1003015 main -> main
Upload file runs/May05_17-05-42_sanchit--v100/events.out.tfevents.1651770393.sanchit--v100.71806.0: 100%|β–ˆ| 9.97k/9.97k
Upload file runs/May05_17-05-42_sanchit--v100/1651770393.8000064/events.out.tfevents.1651770393.sanchit--v100.71806.1: 1
Upload file training_args.bin: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 3.17k/3.17k [00:01<?, ?B/s]
{'dataset': {'name': 'xtreme_s', 'type': 'xtreme_s', 'args': 'covost2.fr.en'}, 'metrics': [{'name': 'Bleu', 'type': 'bleu', 'value': 2.691896075803751e-15}]}
05/05/2022 17:07:46 - WARNING - huggingface_hub.repository - To https://huggingface.co/sanchit-gandhi/xtreme_s_xlsr_2_bart_covost2_fr_en_2
1003015..44a61c0 main -> main
To https://huggingface.co/sanchit-gandhi/xtreme_s_xlsr_2_bart_covost2_fr_en_2
1003015..44a61c0 main -> main
***** train metrics *****
epoch = 3.0
train_loss = 0.0
train_runtime = 0:00:08.00
train_samples = 207374
train_samples_per_second = 77706.136
train_steps_per_second = 1214.076
Saving model checkpoint to ./
Configuration saved in ./config.json
Model weights saved in ./pytorch_model.bin
Feature extractor saved in ./preprocessor_config.json
05/05/2022 17:08:27 - WARNING - huggingface_hub.repository - To https://huggingface.co/sanchit-gandhi/xtreme_s_xlsr_2_bart_covost2_fr_en_2
44a61c0..aa9924b main -> main
To https://huggingface.co/sanchit-gandhi/xtreme_s_xlsr_2_bart_covost2_fr_en_2
44a61c0..aa9924b main -> main
Traceback (most recent call last):
File "/home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en_2/run_xtreme_s.py", line 972, in <module>
main()
File "/home/sanchit_huggingface_co/xtreme_s_xlsr_2_bart_covost2_fr_en_2/run_xtreme_s.py", line 964, in main
trainer.push_to_hub(**kwargs)
File "/home/sanchit_huggingface_co/transformers/src/transformers/trainer.py", line 2944, in push_to_hub
self.create_model_card(model_name=model_name, **kwargs)
File "/home/sanchit_huggingface_co/transformers/src/transformers/trainer.py", line 2841, in create_model_card
training_summary = TrainingSummary.from_trainer(
File "/home/sanchit_huggingface_co/transformers/src/transformers/modelcard.py", line 611, in from_trainer
return cls(
File "<string>", line 16, in __init__
File "/home/sanchit_huggingface_co/transformers/src/transformers/modelcard.py", line 401, in __post_init__
info = model_info(self.finetuned_from)
File "/home/sanchit_huggingface_co/gcp/lib/python3.9/site-packages/huggingface_hub/hf_api.py", line 870, in model_info
return ModelInfo(**d)
TypeError: huggingface_hub.hf_api.ModelInfo() argument after ** must be a mapping, not list