Llimy1 commited on
Commit
047b0fe
1 Parent(s): 83390ad

Llimy1/llama2-chat-micro-inst

Browse files
README.md CHANGED
@@ -42,7 +42,7 @@ The following hyperparameters were used during training:
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: constant
44
  - lr_scheduler_warmup_ratio: 0.03
45
- - num_epochs: 20
46
 
47
  ### Training results
48
 
 
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: constant
44
  - lr_scheduler_warmup_ratio: 0.03
45
+ - num_epochs: 30
46
 
47
  ### Training results
48
 
adapter_config.json CHANGED
@@ -19,8 +19,8 @@
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
- "v_proj",
23
- "q_proj"
24
  ],
25
  "task_type": "CAUSAL_LM",
26
  "use_rslora": false
 
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
+ "q_proj",
23
+ "v_proj"
24
  ],
25
  "task_type": "CAUSAL_LM",
26
  "use_rslora": false
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0024533ece9c7843ffce5451ef514f51a3ff5f4aff339e733546b2aa5a9c2a09
3
  size 134235048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7d00854a24e8a5292e9ec32b5e7a7d46c241349703110019f64ea3d7b56c15a
3
  size 134235048
runs/May22_18-08-52_SERVER-4SEASON/events.out.tfevents.1716368932.SERVER-4SEASON.2159319.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc54574d186dd944f7a765cf1e2cb55562f30cd34fdfc5c3ae245dae25dab62f
3
+ size 11754
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75b9ef4ad6aab26156dd81be592c2306b696f8f6be052b200a2da3b8beae3f80
3
  size 4728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:399bd67e76e37eb5c6e6303a1e02b5d3bb650c8b92f156198ebb7110e21d8b39
3
  size 4728