gemma_merged_ultimate1

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the TIES merge method using google/gemma-3-1b-it as a base.

Models Merged

The following models were included in the merge:

  • ./gemma_qwen3_FULL
  • ./gemma_qwen2.5_FULL

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: ./gemma_qwen3_FULL      # Твоя математическая модель (ДОМИНИРУЮЩАЯ)
    parameters:
      density: 1.0                 # Берем 100% ее нейронов
      weight: 0.85                 # Даем ей 85% силы влияния
  - model: ./gemma_qwen2.5_FULL    # Твоя модель для тегов (ДОБАВКА)
    parameters:
      density: 0.3                 # Берем только топ-30% самых важных изменений (теги)
      weight: 0.15                 # Даем ей 15% силы влияния
merge_method: ties
base_model: google/gemma-3-1b-it
dtype: bfloat16
Downloads last month
4
Safetensors
Model size
1.0B params
Tensor type
BF16
·
Inference Providers NEW
Input a message to start chatting with SAIJO1233/Gemma3-1b-SFT_Teached.

Model tree for SAIJO1233/Gemma3-1b-SFT_Teached

Finetuned
(556)
this model

Paper for SAIJO1233/Gemma3-1b-SFT_Teached