AlekseiPravdin's picture
Create README.md
a503fbc verified
|
raw
history blame
1.08 kB
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - grimjim/kunoichi-lemon-royale-v2-32K-7B
  - AlekseiPravdin/Seamaiiza-7B-v1
  - Nitral-AI/Nyanade_Stunna-Maid-7B

Seamaiiza-7B-v3-32k

Seamaiiza-7B-v3-32k is a merge of the following models using mergekit:

🧩 Configuration

models:
  - model: grimjim/kunoichi-lemon-royale-v2-32K-7B
    # no parameters necessary for base model
  - model: AlekseiPravdin/Seamaiiza-7B-v1
    parameters:
      weight: 0.2
      density: 0.3
  - model: Nitral-AI/Nyanade_Stunna-Maid-7B
    parameters:
      weight: 0.4
      density: 0.5  
merge_method: dare_ties
base_model: grimjim/kunoichi-lemon-royale-v2-32K-7B
parameters:
  int8_mask: true
  normalize: true
dtype: bfloat16