ausboss commited on
Commit
5d7fb6e
1 Parent(s): a0b098f

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -0
README.md ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Lora fine tune trained on this [dataset](https://huggingface.co/datasets/ehartford/WizardLM_alpaca_evol_instruct_70k_unfiltered)
2
+
3
+
4
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
5
+
6
+ ### Instruction:
7
+ {data_point["instruction"]}
8
+
9
+ ### Response:
10
+ {data_point["output"]}
11
+
12
+
13
+ CUDA_VISIBLE_DEVICES=0
14
+ python llama.py model c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors 4bit-128g.safetensors