Edit model card

Recipe

slices:

  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [0, 16]
  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [8, 24]
  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [17, 32]
  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [25, 40]

merge_method: passthrough

dtype: float16

Downloads last month
2
Safetensors
Model size
20B params
Tensor type
FP16
·