File size: 752 Bytes
90f4da7 07e8429 90f4da7 aa82efe 07e8429 aa82efe 07e8429 aa82efe 90f4da7 aa82efe 90f4da7 aa82efe 90f4da7 aa82efe |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |
---
library_name: peft
tags:
- text-generation
- peft
---
# LoRA Text Generation Model
This repository contains a fine-tuned LoRA model designed for text generation.
## Training Details
### Fine-Tuning Procedure
The model was fine-tuned using the following `bitsandbytes` quantization configuration:
- **load_in_8bit:** False
- **load_in_4bit:** True
- **llm_int8_threshold:** 6.0
- **llm_int8_skip_modules:** None
- **llm_int8_enable_fp32_cpu_offload:** False
- **llm_int8_has_fp16_weight:** False
- **bnb_4bit_quant_type:** nf4
- **bnb_4bit_use_double_quant:** True
- **bnb_4bit_compute_dtype:** bfloat16
### Framework Versions
- PEFT 0.4.0
## How to Use
### Installation
Install the necessary libraries:
```bash
pip install transformers
|