biomistral_dare_ties_7b

This model is the result of merge of the following models made with flow-merge:

• Base model:
  • BioMistral/BioMistral-Safetensors
• Models:
  • mistralai/Mistral-7B-Instruct-v0.2

flow-merge config

The following configuration was used to merge the models:

method: dare-ties-merging
method_global_parameters:
  scaling_coefficient: 0.5 # only one model, using global scaling coefficient
  normalize: False
  p: 0.3
base_model: BioMistral/BioMistral-Safetensors
models:
  - model: BioMistral/BioMistral-Safetensors
  - model: mistralai/Mistral-7B-Instruct-v0.2
directory_settings:
  output_dir: ./biomistral/biomistral_dare_ties_7b/
hf_token:
  token: <your_token>
  trust_remote_code: True
device: cuda