Vezora

/

Mistral-14b-Merge-Base

like 2

It would look something like this I no longer have the exact one I used but this is the same:

slices:
  - sources:
    - model: C:\Users\PC\Documents\text-generation-webui\models\mistral-7b
      layer_range: [0, 32]
  - sources:
    - model: C:\Users\PC\Documents\text-generation-webui\models\Mistral-7B
      layer_range: [0, 32]
merge_method: passthrough
dtype: bfloat16

Thank you. So the layers are duplicated?

essentially it just adds the two models on top of each other, granted I used two different fine tuned models, for example reasons I wrote mistral 7b twice.

OK, makes sense. Thank you.