Update README.md
Browse files
README.md
CHANGED
@@ -7,8 +7,7 @@ Welcome to the official repository of JetMoE-8B-chat, a language model that comb
|
|
7 |
- **Cost-Effective Training**: Achieved at less than $0.1 million, JetMoE-8B significantly lowers the barrier to entry for training large language models (LLMs), demonstrating that high-quality LLM training can be far more economical than widely assumed.
|
8 |
- **Academia-Friendly**: By relying exclusively on public datasets and open-sourcing our code, JetMoE-8B is highly accessible for educational and research purposes. It is designed to be fine-tuned even on consumer-grade GPUs, making it feasible for most academic labs.
|
9 |
- **Efficiency at Scale**: With only 2.2B active parameters during inference, JetMoE-8B provides an optimal balance between computational cost and performance, outperforming similarly sized models such as Gemma-2B across various benchmarks.
|
10 |
-
|
11 |
-
- JetMoE-8B-chat has been evaluated using the MT-Bench. Here is how JetMoE-8B-chat compares with other models:
|
12 |
|
13 |
| Model | Score |
|
14 |
|---------------------|-----------|
|
|
|
7 |
- **Cost-Effective Training**: Achieved at less than $0.1 million, JetMoE-8B significantly lowers the barrier to entry for training large language models (LLMs), demonstrating that high-quality LLM training can be far more economical than widely assumed.
|
8 |
- **Academia-Friendly**: By relying exclusively on public datasets and open-sourcing our code, JetMoE-8B is highly accessible for educational and research purposes. It is designed to be fine-tuned even on consumer-grade GPUs, making it feasible for most academic labs.
|
9 |
- **Efficiency at Scale**: With only 2.2B active parameters during inference, JetMoE-8B provides an optimal balance between computational cost and performance, outperforming similarly sized models such as Gemma-2B across various benchmarks.
|
10 |
+
- **Good Performence** JetMoE-8B-chat has been evaluated using the MT-Bench, surpassing Llama-2-13b-chat and Vicuna-13b-v1.3. Here is how JetMoE-8B-chat compares with other models:
|
|
|
11 |
|
12 |
| Model | Score |
|
13 |
|---------------------|-----------|
|