MINI AI
Collection
The mini AI series ; I found that i needed smaller models for other models such as VisionEncoderDecoder : and other models which contain llms as a par
•
29 items
•
Updated
This is a merge of pre-trained language models created using mergekit.
This model was merged using the linear merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: LeroyDyer/Mini_Merge_Dolphin
parameters:
weight: 0.58944
- model: LeroyDyer/Mixtral_AI_Minitron_2b_Base
parameters:
weight: 0.4453
- model: LeroyDyer/Mixtral_AI_Minitron_2b_2m
parameters:
weight: 0.58944
- model: LeroyDyer/Mixtral_AI_Minitron_2b_2.0
parameters:
weight: 0.4453
- model: LeroyDyer/Mixtral_AI_Minitron_2b_1.0
parameters:
weight: 0.4453
- model: LeroyDyer/Mini_Merge_Greeting
parameters:
weight: 0.4453
merge_method: linear
dtype: float16