File size: 607 Bytes
fb95f6e 706beae 7f6b40c 706beae |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
pipeline_tag: feature-extraction
---
## Overview
This is a bare model without any output layer or classification head. It has been quantized to be used for feature extraction tasks.
**Usage**
This model is intended to be used as a base for training on downstream tasks. In order to use it for predictions and inference, it should be fine-tuned on a specific task with an appropriate output layer or classification head added.
**Quantization**
The model has been quantized using the following parameters:
Lora alpha: 16
Lora rank: 32
Lora target modules: all-linear
bits: 4
LoftQ iterations: 5 |