Muennighoff
commited on
Commit
•
3982c32
1
Parent(s):
9720470
Add cmd to README.md
Browse files
README.md
CHANGED
@@ -12,6 +12,11 @@ tags:
|
|
12 |
|
13 |
For usage instructions, refer to: https://github.com/Muennighoff/sgpt#symmetric-semantic-search
|
14 |
|
|
|
|
|
|
|
|
|
|
|
15 |
## Evaluation Results
|
16 |
|
17 |
`{'askubuntu': 57.44, 'cqadupstack': 14.18, 'twitterpara': 73.99, 'scidocs': 74.74, 'avg': 55.087500000000006}`
|
|
|
12 |
|
13 |
For usage instructions, refer to: https://github.com/Muennighoff/sgpt#symmetric-semantic-search
|
14 |
|
15 |
+
The model was trained with the command
|
16 |
+
```bash
|
17 |
+
CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 accelerate launch examples/training/nli/training_nli_v2.py --model_name bigscience/bloom-1b3 --freezenonbias --train_batch_size 128 --lr 32e-5 --pooling weightedmean --wandb --wandbwatchlog gradients --gradcache --chunksize 4
|
18 |
+
```
|
19 |
+
|
20 |
## Evaluation Results
|
21 |
|
22 |
`{'askubuntu': 57.44, 'cqadupstack': 14.18, 'twitterpara': 73.99, 'scidocs': 74.74, 'avg': 55.087500000000006}`
|