Muennighoff commited on
Commit
3982c32
1 Parent(s): 9720470

Add cmd to README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -12,6 +12,11 @@ tags:
12
 
13
  For usage instructions, refer to: https://github.com/Muennighoff/sgpt#symmetric-semantic-search
14
 
 
 
 
 
 
15
  ## Evaluation Results
16
 
17
  `{'askubuntu': 57.44, 'cqadupstack': 14.18, 'twitterpara': 73.99, 'scidocs': 74.74, 'avg': 55.087500000000006}`
 
12
 
13
  For usage instructions, refer to: https://github.com/Muennighoff/sgpt#symmetric-semantic-search
14
 
15
+ The model was trained with the command
16
+ ```bash
17
+ CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 accelerate launch examples/training/nli/training_nli_v2.py --model_name bigscience/bloom-1b3 --freezenonbias --train_batch_size 128 --lr 32e-5 --pooling weightedmean --wandb --wandbwatchlog gradients --gradcache --chunksize 4
18
+ ```
19
+
20
  ## Evaluation Results
21
 
22
  `{'askubuntu': 57.44, 'cqadupstack': 14.18, 'twitterpara': 73.99, 'scidocs': 74.74, 'avg': 55.087500000000006}`