disinfozone
commited on
Corrected target modules for training information.
Browse files
README.md
CHANGED
@@ -25,6 +25,7 @@ The training dataset for `Disinfo4_mistral-ft-optimized-1218` remains confidenti
|
|
25 |
- **Training Environment:** Utilized `text-generation-webui` on an NVIDIA RTX 3090.
|
26 |
- **Training Dataset Size:** 7MB raw data corpus.
|
27 |
- **Training Configuration:**
|
|
|
28 |
- LoRA Rank: 256
|
29 |
- LoRA Alpha: 512
|
30 |
- Batch Size: 4
|
|
|
25 |
- **Training Environment:** Utilized `text-generation-webui` on an NVIDIA RTX 3090.
|
26 |
- **Training Dataset Size:** 7MB raw data corpus.
|
27 |
- **Training Configuration:**
|
28 |
+
- Target Modules: q, v, k, o, gate, down, up
|
29 |
- LoRA Rank: 256
|
30 |
- LoRA Alpha: 512
|
31 |
- Batch Size: 4
|