Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,8 @@ datasets:
|
|
| 7 |
- EagleConsortium/MrEagle-2126
|
| 8 |
---
|
| 9 |
|
|
|
|
|
|
|
| 10 |
MrEagle-LoRA is a large language model (LLM) based on Llama2-7B-Chat created by finetuning a LoRA from a dataset of 2,126 1-turn conversations artificially generated using GPT-4. The conversations were designed to fit the tone of the Discord bot Mr. Eagle.
|
| 11 |
|
| 12 |
We recommend that you run the largest model that functions on your device. The Q4_K_M model offers a good balance of performance and speed.
|
|
|
|
| 7 |
- EagleConsortium/MrEagle-2126
|
| 8 |
---
|
| 9 |
|
| 10 |
+
NOTE: DO NOT USE THIS–QUANTIZATION RENDERS THIS LORA-BASED MODEL UNUSABLE. USE THE HF PYTORCH MERGED MODEL OR GPTQ INSTEAD.
|
| 11 |
+
|
| 12 |
MrEagle-LoRA is a large language model (LLM) based on Llama2-7B-Chat created by finetuning a LoRA from a dataset of 2,126 1-turn conversations artificially generated using GPT-4. The conversations were designed to fit the tone of the Discord bot Mr. Eagle.
|
| 13 |
|
| 14 |
We recommend that you run the largest model that functions on your device. The Q4_K_M model offers a good balance of performance and speed.
|