Sakalti
/

model-4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

model-4 / mergekit_config.yml

Sakalti's picture

Upload folder using huggingface_hub

f6dc823 verified 2 months ago

232 Bytes

	models:
	- model: Qwen/Qwen2.5-1.5B-Instruct
	parameters:
	weight: 1
	density: 1
	merge_method: ties
	base_model: Qwen/Qwen2.5-1.5B
	parameters:
	weight: 1
	density: 1
	normalize: true
	int8_mask: true
	dtype: bfloat16