Update README.md
Browse files
README.md
CHANGED
@@ -7,6 +7,13 @@ This is GreenBitAI's pretrained **2-bit** LLaMA model with extreme compression y
|
|
7 |
|
8 |
Please refer to our [Github page](https://github.com/GreenBitAI/low_bit_llama) for the code to run the model and more information.
|
9 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
## Zero-Shot Evaluation
|
11 |
| Task | Metric | LLaMA 3B q2g32 | LLaMA 3B q2g16 | LLaMA 3B q2g8 | LLaMA-1 7B q2g32 | LLaMA-2 7B q2g32 | LLaMA-2 7B q2g8 | LLaMA 3B FP16 | LLaMA-1 7B FP16 |
|
12 |
|---------------|----------|----------------|----------------|--------------|------------------|------------------|----------------|--------------|-----------------|
|
|
|
7 |
|
8 |
Please refer to our [Github page](https://github.com/GreenBitAI/low_bit_llama) for the code to run the model and more information.
|
9 |
|
10 |
+
## Model Description
|
11 |
+
|
12 |
+
- **Developed by:** [GreenBitAI](https://github.com/GreenBitAI)
|
13 |
+
- **Model type:** Causal (Llama 2)
|
14 |
+
- **Language(s) (NLP):** English
|
15 |
+
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0), [Llama 2 license agreement](https://ai.meta.com/resources/models-and-libraries/llama-downloads/)
|
16 |
+
|
17 |
## Zero-Shot Evaluation
|
18 |
| Task | Metric | LLaMA 3B q2g32 | LLaMA 3B q2g16 | LLaMA 3B q2g8 | LLaMA-1 7B q2g32 | LLaMA-2 7B q2g32 | LLaMA-2 7B q2g8 | LLaMA 3B FP16 | LLaMA-1 7B FP16 |
|
19 |
|---------------|----------|----------------|----------------|--------------|------------------|------------------|----------------|--------------|-----------------|
|