DoubleFactor-20b / README.md
athirdpath's picture
Create README.md
3fcb96f
metadata
license: llama2

Recipe

slices:

  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [0, 16]
  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [8, 24]
  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [17, 32]
  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [25, 40]

merge_method: passthrough

dtype: float16