Update README.md
Browse files
README.md
CHANGED
@@ -6,7 +6,7 @@ license: apache-2.0
|
|
6 |
|
7 |
# Mistral 14b: A New Base Model
|
8 |
|
9 |
-
The objective of this model is to serve as a new base model
|
10 |
|
11 |
With full fine-tuning, this model has the potential to deliver excellent performance.
|
12 |
|
|
|
6 |
|
7 |
# Mistral 14b: A New Base Model
|
8 |
|
9 |
+
The objective of this model is to serve as a fully open source new base model with 14.3 billion parameters. It has been enhanced with a LoRa adapter attached to all 62 layers of the merged model. The model is capable of generating outputs and responding accurately to inputs. However, it tends to over-respond with unasked questions when asked to process more than 512 tokens, which is its training limit using QLoRa.
|
10 |
|
11 |
With full fine-tuning, this model has the potential to deliver excellent performance.
|
12 |
|