Configuration Parsing Warning:In config.json: "quantization_config.modules_to_not_convert" must be an array
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quantization made by Richard Erkhov.
2_PRYMMAL-ECE-2B-SLERP-V1 - AWQ
- Model creator: https://huggingface.co/Lil-R/
- Original model: https://huggingface.co/Lil-R/2_PRYMMAL-ECE-2B-SLERP-V1/
Original model description:
base_model: - google/gemma-2-2b-jpn-it - zake7749/gemma-2-2b-it-chinese-kyara-dpo library_name: transformers tags: - mergekit - merge license: apache-2.0
merged_model
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the SLERP merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: zake7749/gemma-2-2b-it-chinese-kyara-dpo
layer_range: [0, 26]
- model: google/gemma-2-2b-jpn-it
layer_range: [0, 26]
merge_method: slerp
base_model: zake7749/gemma-2-2b-it-chinese-kyara-dpo
parameters:
t:
- filter: self_attn
value: [0, 0.25, 0.5, 0.75, 1]
- filter: mlp
value: [1, 0.75, 0.5, 0.25, 0]
- value: 0.5
dtype: bfloat16
- Downloads last month
- 7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support