fblgit commited on
Commit
8dbecd6
1 Parent(s): db160d4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -72,7 +72,7 @@ Here there are some, but we also submitted it to the HF eval queue....
72
  | | |none | 0|acc_norm |0.9370|± |0.0077|
73
  ```
74
 
75
- ## BBH
76
  ```
77
  vllm (pretrained=fblgit/UNAversal-8x7B-v1beta,tensor_parallel_size=2,data_parallel_size=4,gpu_memory_utilization=0.8,dtype=float16), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: auto
78
  | Tasks |Version| Filter |n-shot| Metric |Value | |Stderr|
 
72
  | | |none | 0|acc_norm |0.9370|± |0.0077|
73
  ```
74
 
75
+ ## BBH at 0-Shot
76
  ```
77
  vllm (pretrained=fblgit/UNAversal-8x7B-v1beta,tensor_parallel_size=2,data_parallel_size=4,gpu_memory_utilization=0.8,dtype=float16), gen_kwargs: (None), limit: None, num_fewshot: 0, batch_size: auto
78
  | Tasks |Version| Filter |n-shot| Metric |Value | |Stderr|