dahara1 commited on
Commit
85e7ca0
1 Parent(s): ac15cfd

Update finetune_sample/README.md

Browse files
Files changed (1) hide show
  1. finetune_sample/README.md +8 -5
finetune_sample/README.md CHANGED
@@ -8,12 +8,13 @@ python3 -m venv gptq_finetune
8
  source gptq_finetune/bin/activate
9
 
10
 
11
- pip install transformers==4.32.1
12
  pip install datasets
13
  pip install peft==0.5.0
14
  pip install trl
15
  pip install auto-gptq
16
  pip install optimum
 
17
 
18
  # finetune qlora
19
  python3 finetune.py
@@ -30,15 +31,17 @@ ValueError: Target module QuantLinear() is not supported. Currently, only `torch
30
  It's because peft old version.
31
 
32
  I don't know if it's required, but the version of my running environment.
33
- * auto-gptq 0.4.1+cu117
34
- * trl 0.7.1
35
- * optimum 1.12.1.dev0
36
- * datasets 2.14.4
37
 
38
  The official documentation says to install from source, but sometimes that causes errors.
39
  If you can't get it to work, it might be better to wait until the stable version comes out.
40
  Good luck!
41
 
 
 
42
 
43
  - finetune.py gptq finetune sample file.
44
  - jawiki3.csv sample data.(Japanese)
 
8
  source gptq_finetune/bin/activate
9
 
10
 
11
+ pip install transformers==4.34.1
12
  pip install datasets
13
  pip install peft==0.5.0
14
  pip install trl
15
  pip install auto-gptq
16
  pip install optimum
17
+ pip install torch==2.0.1
18
 
19
  # finetune qlora
20
  python3 finetune.py
 
31
  It's because peft old version.
32
 
33
  I don't know if it's required, but the version of my running environment.
34
+ * auto-gptq 0.4.2
35
+ * trl 0.7.2
36
+ * optimum 1.13.2
37
+ * datasets 2.14.6
38
 
39
  The official documentation says to install from source, but sometimes that causes errors.
40
  If you can't get it to work, it might be better to wait until the stable version comes out.
41
  Good luck!
42
 
43
+ If you encounter "RuntimeError: Unrecognized tensor type ID: AutocastCUDA", chech your torch version.
44
+
45
 
46
  - finetune.py gptq finetune sample file.
47
  - jawiki3.csv sample data.(Japanese)