Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
Paper • 2203.05482 • Published • 10
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quantization made by Richard Erkhov.
Pocky_9B - bnb 4bits
- Model creator: https://huggingface.co/ChaoticNeutrals/
- Original model: https://huggingface.co/ChaoticNeutrals/Pocky_9B/
Original model description:
base_model: - jeiku/Re-Host_Limarp_Mistral library_name: transformers tags: - mergekit - merge license: other
shortRad
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the linear merge method.
Models Merged
The following models were included in the merge:
- shorter + jeiku/Re-Host_Limarp_Mistral
Configuration
The following YAML configuration was used to produce this model:
merge_method: linear
models:
- model: shorter+jeiku/Re-Host_Limarp_Mistral
parameters:
weight: 1
dtype: float16
- Downloads last month
- 7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support