Hugging Face's logo

thrunlab
/
llama_7b_hf_relu_refined_web_relu_2024-03-27

Text Generation
Transformers
Safetensors
sparse_llama
Generated from Trainer
custom_code
Model card Files Community
lukeleeai commited on
Commit
8736831
·
verified ·
1 Parent(s): dfe7bae

Training in progress, step 1000

Browse files
Files changed (3) hide show
  1. adapter_config.json +2 -2
  2. adapter_model.safetensors +1 -1
  3. training_args.bin +1 -1
adapter_config.json CHANGED
@@ -23,8 +23,8 @@
23
  "gate_proj",
24
  "q_proj",
25
  "up_proj",
26
- "down_proj",
27
- "v_proj"
28
  ],
29
  "task_type": "CAUSAL_LM",
30
  "use_dora": false,
 
23
  "gate_proj",
24
  "q_proj",
25
  "up_proj",
26
+ "v_proj",
27
+ "down_proj"
28
  ],
29
  "task_type": "CAUSAL_LM",
30
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c4c222e7528c330b38af10786c5f1c26869226e8af02047421a8c517176db0ee
3
  size 252750032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d079594607a497f177f20b0a579a1be22c21a3bd27af173cd2655424c5196c8e
3
  size 252750032
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2278e00be8adb6c9fd617484ab363a81e0e96f50e5e27ce9f049e511053491b5
3
  size 6712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d1a66be3715686621a094dd87b10c5ec98687a7032c76c367f68b2b276a5a6e
3
  size 6712