bssachde commited on
Commit
2702618
1 Parent(s): dbea680

Create README.md

Browse files

Created this model from BLOOM 560m base as a test for my small personal GPU.
Trained on 30 % of the SQUAD 1.0 dataset.

```
{'eval_loss': 6.210013389587402, 'eval_runtime': 9310.8833, 'eval_samples_per_second': 0.43, 'eval_steps_per_second': 0.107, 'epoch': 3.0}
{'train_runtime': 52012.0203, 'train_samples_per_second': 0.058, 'train_steps_per_second': 0.058, 'train_loss': 5.395830729166667, 'epoch': 3.0}
```

Files changed (1) hide show
  1. README.md +8 -0
README.md ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: bigscience-openrail-m
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ tags:
7
+ - squad
8
+ ---