athirdpath/PivotMaid-Starling-11b

A 11b Mistral model, based on the NeverSleep recipe.

Recipe

slices

• sources:

• • model: NeverSleep/Noromaid-7b-v0.1.1
  • layer_range: [0, 24]

• sources:

• • model: maywell/PiVoT-0.1-Starling-LM-RP
  • layer_range: [8, 32]

merge_method: passthrough

dtype: bfloat16