Edit model card

Untitled

This model is the result of merge of the following models made with flow-merge:

  • Base model:
    • Qwen/Qwen1.5-0.5B
  • Models:
    • Qwen/Qwen1.5-0.5B-chat
    • minghaowu/Qwen1.5-0.5B-OpenHermes-2.5

flow-merge config

The following configuration was used to merge the models:

base_model: Qwen/Qwen1.5-0.5B
models:
- path_or_id: Qwen/Qwen1.5-0.5B
- path_or_id: Qwen/Qwen1.5-0.5B-chat
- path_or_id: minghaowu/Qwen1.5-0.5B-OpenHermes-2.5
method: addition-task-arithmetic
device: !!python/object/apply:flow_merge.lib.constants.DeviceIdentifier
- cpu
method_global_parameters:
  scaling_coefficient: 0.7
  normalize: false
directory_settings:
  cache_dir: null
  local_dir: ./models
  output_dir: ./merged_model
Downloads last month
2
Safetensors
Model size
619M params
Tensor type
BF16
·