Update README.md
Browse files
README.md
CHANGED
|
@@ -6,7 +6,7 @@ license: apache-2.0
|
|
| 6 |
|
| 7 |
# Mistral 14b: A New Base Model
|
| 8 |
|
| 9 |
-
The objective of this model is to serve as a new base model
|
| 10 |
|
| 11 |
With full fine-tuning, this model has the potential to deliver excellent performance.
|
| 12 |
|
|
|
|
| 6 |
|
| 7 |
# Mistral 14b: A New Base Model
|
| 8 |
|
| 9 |
+
The objective of this model is to serve as a fully open source new base model with 14.3 billion parameters. It has been enhanced with a LoRa adapter attached to all 62 layers of the merged model. The model is capable of generating outputs and responding accurately to inputs. However, it tends to over-respond with unasked questions when asked to process more than 512 tokens, which is its training limit using QLoRa.
|
| 10 |
|
| 11 |
With full fine-tuning, this model has the potential to deliver excellent performance.
|
| 12 |
|