Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
Paper • 2203.05482 • Published • 8
How to use ymatsui1122/clipcap_person_only_linear_merged with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("ymatsui1122/clipcap_person_only_linear_merged")
model = AutoModel.from_pretrained("ymatsui1122/clipcap_person_only_linear_merged")This is a merge of pre-trained language models created using mergekit.
This model was merged using the Linear merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
merge_method: linear
models:
- model: ymatsui1122/clipcap_person_only_coco_a
- model: ymatsui1122/clipcap_person_only_coco_b
parameters:
weight: [0.5, 0.5]
normalize: true
tokenizer:
source: "base"