disinfozone commited on
Commit
c69aded
1 Parent(s): 6402ae9

Corrected target modules for training information.

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -25,6 +25,7 @@ The training dataset for `Disinfo4_mistral-ft-optimized-1218` remains confidenti
25
  - **Training Environment:** Utilized `text-generation-webui` on an NVIDIA RTX 3090.
26
  - **Training Dataset Size:** 7MB raw data corpus.
27
  - **Training Configuration:**
 
28
  - LoRA Rank: 256
29
  - LoRA Alpha: 512
30
  - Batch Size: 4
 
25
  - **Training Environment:** Utilized `text-generation-webui` on an NVIDIA RTX 3090.
26
  - **Training Dataset Size:** 7MB raw data corpus.
27
  - **Training Configuration:**
28
+ - Target Modules: q, v, k, o, gate, down, up
29
  - LoRA Rank: 256
30
  - LoRA Alpha: 512
31
  - Batch Size: 4