Update README.md
Browse files
README.md
CHANGED
@@ -2,6 +2,8 @@
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
|
|
|
|
5 |
# Mistral 14b: A New Base Model
|
6 |
|
7 |
The objective of this model is to serve as a new base model for Mistral 14b. It has been enhanced with a LoRa adapter attached to all 62 layers of the merged model. The model is capable of generating outputs and responding accurately to inputs. However, it tends to over-respond with unasked questions when asked to process more than 512 tokens, which is its training limit using QLoRa.
|
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
+
<img src="https://imgur.com/a/3HUIVxJ" width="300" alt="Description of the image">
|
6 |
+
|
7 |
# Mistral 14b: A New Base Model
|
8 |
|
9 |
The objective of this model is to serve as a new base model for Mistral 14b. It has been enhanced with a LoRa adapter attached to all 62 layers of the merged model. The model is capable of generating outputs and responding accurately to inputs. However, it tends to over-respond with unasked questions when asked to process more than 512 tokens, which is its training limit using QLoRa.
|