smallsuper commited on
Commit
3de4dab
1 Parent(s): 14b8889

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -1
README.md CHANGED
@@ -1,4 +1,25 @@
1
  ---
2
  pipeline_tag: feature-extraction
3
  ---
4
- # Note this a bare model without any output layer or classification head. Quantized to be used for feature extraction task.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  pipeline_tag: feature-extraction
3
  ---
4
+
5
+ ## Overview
6
+
7
+ This is a bare model without any output layer or classification head. It has been quantized to be used for feature extraction tasks.
8
+
9
+ **Usage**
10
+
11
+ This model is intended to be used as a base for training on downstream tasks. In order to use it for predictions and inference, it should be fine-tuned on a specific task with an appropriate output layer or classification head added.
12
+
13
+ **Quantization**
14
+
15
+ The model has been quantized using the following parameters:
16
+
17
+ Lora alpha: 16
18
+
19
+ Lora rank: 8
20
+
21
+ Lora target modules: all-linear
22
+
23
+ bits: 4
24
+
25
+ LoftQ iterations: 5