Update README.md
Browse files
README.md
CHANGED
|
@@ -12,3 +12,11 @@ This is a Vicuna-like model with only 160M parameters, which is fine-tuned from
|
|
| 12 |
The training setup follows the [Vicuna suite](https://github.com/lm-sys/FastChat).
|
| 13 |
|
| 14 |
The model is mainly developed as a base Small Speculative Model. As a comparison, it can be better aligned to the Vicuna models than LLaMA-160m with little loss of alignment to the LLaMA models.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
The training setup follows the [Vicuna suite](https://github.com/lm-sys/FastChat).
|
| 13 |
|
| 14 |
The model is mainly developed as a base Small Speculative Model. As a comparison, it can be better aligned to the Vicuna models than LLaMA-160m with little loss of alignment to the LLaMA models.
|
| 15 |
+
|
| 16 |
+
| Draft Model | Target Model | Alignment |
|
| 17 |
+
| -------------- | ------------- | --------- |
|
| 18 |
+
| LLaMA-68/160M | LLaMA-13/33B | 😃 |
|
| 19 |
+
| LLaMA-68/160M | Vicuna-13/33B | 😟 |
|
| 20 |
+
| Vicuna-68/160M | LLaMA-13/33B | 😃 |
|
| 21 |
+
| Vicuna-68/160M | Vicuna-13/33B | 😃 |
|
| 22 |
+
|