Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
Paper • 2203.05482 • Published • 10
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quantization made by Richard Erkhov.
Average_Test_v1 - bnb 8bits
- Model creator: https://huggingface.co/jeiku/
- Original model: https://huggingface.co/jeiku/Average_Test_v1/
Original model description:
base_model:
- jeiku/Average_Test
- ResplendentAI/Aura_Llama3 library_name: transformers tags:
- mergekit
- merge
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the linear merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: jeiku/Average_Test+ResplendentAI/Aura_Llama3
parameters:
weight: 1.0
merge_method: linear
dtype: float16
- Downloads last month
- 4
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support