| Lora fine tune trained on this [dataset](https://huggingface.co/datasets/ehartford/WizardLM_alpaca_evol_instruct_70k_unfiltered) | |
| ```python | |
| Below is an instruction that describes a task. Write a response that appropriately completes the request. | |
| ### Instruction: | |
| {data_point["instruction"]} | |
| ### Response: | |
| {data_point["output"]} | |
| ``` | |
| CUDA_VISIBLE_DEVICES=0 | |
| python llama.py model c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors 4bit-128g.safetensors |