cpt3_decay_strong__base_slerp_075

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

/opt/dlami/nvme/models/merged/cpt3_decay_strong
mistralai/Ministral-3-14B-Base-2512

Configuration

The following YAML configuration was used to produce this model:

name: cpt3_decay_strong__base_slerp_075
merge_method: slerp
base_model: mistralai/Ministral-3-14B-Base-2512
models:
  - model: /opt/dlami/nvme/models/merged/cpt3_decay_strong
parameters:
  t: 0.75
dtype: bfloat16

Downloads last month: 16

Safetensors

Model size

14B params

Tensor type

BF16

Model tree for ilsp/base_slerp

Base model

mistralai/Ministral-3-14B-Base-2512

Finetuned

(17)

this model