Hugging Face's logo

indischepartij
/
TinyUltra-4x1.1B-Base-Alpha

Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
Merge
mergekit
conversational
Eval Results
Inference Endpoints
text-generation-inference
Model card Files Community
2
gmonsoon commited on
Commit
228f068
•
1 Parent(s): 61b2a3f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -5,7 +5,6 @@ tags:
5
  - frankenmoe
6
  - merge
7
  - mergekit
8
- - lazymergekit
9
  - TinyLlama/TinyLlama-1.1B-Chat-v1.0
10
  - vihangd/DopeyTinyLlama-1.1B-v1
11
  - cognitivecomputations/TinyDolphin-2.8.1-1.1b
@@ -19,7 +18,7 @@ base_model:
19
 
20
  # TinyUltra-4x1.1B-Base-Alpha
21
 
22
- TinyUltra-4x1.1B-Base-Alpha is a Mixure of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
23
  * [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
24
  * [vihangd/DopeyTinyLlama-1.1B-v1](https://huggingface.co/vihangd/DopeyTinyLlama-1.1B-v1)
25
  * [cognitivecomputations/TinyDolphin-2.8.1-1.1b](https://huggingface.co/cognitivecomputations/TinyDolphin-2.8.1-1.1b)
 
5
  - frankenmoe
6
  - merge
7
  - mergekit
 
8
  - TinyLlama/TinyLlama-1.1B-Chat-v1.0
9
  - vihangd/DopeyTinyLlama-1.1B-v1
10
  - cognitivecomputations/TinyDolphin-2.8.1-1.1b
 
18
 
19
  # TinyUltra-4x1.1B-Base-Alpha
20
 
21
+ TinyUltra-4x1.1B-Base-Alpha is a Mixure of Experts (MoE) made with the following models using MergeKit:
22
  * [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
23
  * [vihangd/DopeyTinyLlama-1.1B-v1](https://huggingface.co/vihangd/DopeyTinyLlama-1.1B-v1)
24
  * [cognitivecomputations/TinyDolphin-2.8.1-1.1b](https://huggingface.co/cognitivecomputations/TinyDolphin-2.8.1-1.1b)