Meiya-13B

I just combined a set of 13Bs that I considered worthwhile. There's no profound reasoning behind my choices. Alpaca works best. Use SillyTavern's Universal-Light preset with just a sprinkle of rep pen.

Merge config.yml:

  - model: Gryphe/MergeMonster-13b-20231124
    parameters:
      density: [1, 0.65, 0.17] 
      weight: 1.0
  - model: NeverSleep/Noromaid-13b-v0.2
    parameters:
      density: 0.5
      weight: [0, 0.4, 0.8, 1] 
  - model: FlatOrca
    parameters:
      density: 0.33
      weight:
        - filter: mlp
          value: 0.5
        - value: 0
merge_method: ties
base_model: TheBloke/Llama-2-13B-fp16
parameters:
  normalize: true
  int8_mask: true
dtype: float16

Never let aNCHOR cook again.