Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Lora fine tune trained on this [dataset](https://huggingface.co/datasets/ehartford/WizardLM_alpaca_evol_instruct_70k_unfiltered)
|
2 |
+
|
3 |
+
|
4 |
+
Below is an instruction that describes a task. Write a response that appropriately completes the request.
|
5 |
+
|
6 |
+
### Instruction:
|
7 |
+
{data_point["instruction"]}
|
8 |
+
|
9 |
+
### Response:
|
10 |
+
{data_point["output"]}
|
11 |
+
|
12 |
+
|
13 |
+
CUDA_VISIBLE_DEVICES=0
|
14 |
+
python llama.py model c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors 4bit-128g.safetensors
|