add lora technique
Browse files
README.md
CHANGED
@@ -13,8 +13,9 @@ tags:
|
|
13 |
|
14 |

|
15 |
|
16 |
-
This model is a fine-tuned version of [llama-7b](https://huggingface.co/decapoda-research/llama-7b-hf) from [Meta](https://huggingface.co/facebook)
|
17 |
-
on the [Natural Instructions](https://huggingface.co/datasets/Muennighoff/natural-instructions) dataset from [AllenAI](https://huggingface.co/allenai)
|
|
|
18 |
|
19 |
⚠️ **This model is for Research purpose only (See the [license](https://huggingface.co/decapoda-research/llama-7b-hf/blob/main/LICENSE))**
|
20 |
|
|
|
13 |
|
14 |

|
15 |
|
16 |
+
This model is a fine-tuned version of [llama-7b](https://huggingface.co/decapoda-research/llama-7b-hf) from [Meta](https://huggingface.co/facebook),
|
17 |
+
on the [Natural Instructions](https://huggingface.co/datasets/Muennighoff/natural-instructions) dataset from [AllenAI](https://huggingface.co/allenai),
|
18 |
+
using the [LoRA](https://arxiv.org/pdf/2106.09685.pdf) training technique.
|
19 |
|
20 |
⚠️ **This model is for Research purpose only (See the [license](https://huggingface.co/decapoda-research/llama-7b-hf/blob/main/LICENSE))**
|
21 |
|