wordcab
/

llama-natural-instructions-7b

Text Generation

text-generation-inference

Model card Files Files and versions Community

chainyo commited on Apr 7, 2023

Commit

5fcfcdf

·

1 Parent(s): 382b743

fix table

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -160,8 +160,8 @@ You can try with other prompts that are not maths related as well! :hugs:
 We benchmarked our model on the following tasks: [BoolQ](https://huggingface.co/datasets/boolq), [PIQA](https://huggingface.co/datasets/piqa), [WinoGrande](https://huggingface.co/datasets/winogrande), [OpenBookQA](https://huggingface.co/datasets/openbookqa).
-| | BoolQ | PIQA | WinoGrande | OpenBookQA | Precision | Inference time (s) |
-| --- | --- | --- | --- | --- | --- | --- | --- | --- |
 | Original LLaMA 7B | 76.5 | 79.8 | 70.1 | 57.2 | fp32 | 3 seconds |
 | Original LLaMA 13B | 78.1 | 80.1 | 73 | 56.4 | fp32 | >5 seconds |
 | LoRA LLaMA 7B | 63.9 | 51.3 | 48.9 | 31.4 | 8bit | 0.65 seconds |

 We benchmarked our model on the following tasks: [BoolQ](https://huggingface.co/datasets/boolq), [PIQA](https://huggingface.co/datasets/piqa), [WinoGrande](https://huggingface.co/datasets/winogrande), [OpenBookQA](https://huggingface.co/datasets/openbookqa).
+|     | BoolQ | PIQA | WinoGrande | OpenBookQA | Precision | Inference time (s) |
+| --- | ---   | ---  | ---        | ---        | ---       | ---                |
 | Original LLaMA 7B | 76.5 | 79.8 | 70.1 | 57.2 | fp32 | 3 seconds |
 | Original LLaMA 13B | 78.1 | 80.1 | 73 | 56.4 | fp32 | >5 seconds |
 | LoRA LLaMA 7B | 63.9 | 51.3 | 48.9 | 31.4 | 8bit | 0.65 seconds |