Update README.md
Browse files
README.md
CHANGED
|
@@ -3,6 +3,9 @@ datasets:
|
|
| 3 |
- jondurbin/airoboros-gpt4-1.4.1
|
| 4 |
---
|
| 5 |
# RoPE Scaled QLoRA Finetune of airoboros-33b-gpt4-1.4.1 (GPTQ)
|
|
|
|
|
|
|
|
|
|
| 6 |
## Overview
|
| 7 |
|
| 8 |
This is [Jon Durbin's Airoboros 33B GPT4 1.4](https://huggingface.co/jondurbin/airoboros-33b-gpt4-1.4) (merged model with GPTQ Quantization) with several key modifications:
|
|
|
|
| 3 |
- jondurbin/airoboros-gpt4-1.4.1
|
| 4 |
---
|
| 5 |
# RoPE Scaled QLoRA Finetune of airoboros-33b-gpt4-1.4.1 (GPTQ)
|
| 6 |
+
|
| 7 |
+
LoRA Weights can be found here: https://huggingface.co/bhenrym14/airoboros-33b-gpt4-1.4.1-PI-8192-LoRA
|
| 8 |
+
|
| 9 |
## Overview
|
| 10 |
|
| 11 |
This is [Jon Durbin's Airoboros 33B GPT4 1.4](https://huggingface.co/jondurbin/airoboros-33b-gpt4-1.4) (merged model with GPTQ Quantization) with several key modifications:
|