NickyNicky
/

TinyDolphin-2.8-1.1b_oasst2_chatML_all_Cluster_dare_ties_v1

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

TinyDolphin-2.8-1.1b_oasst2_chatML_all_Cluster_dare_ties_v1 / mergekit_config.yml

NickyNicky's picture

Upload folder using huggingface_hub

66bb2c6 verified 5 months ago

raw history blame contribute delete

No virus

801 Bytes

	base_model:
	model:
	path: NickyNicky/TinyDolphin-2.8-1.1b_oasst2_chatML_Cluster_1_V1
	dtype: bfloat16
	merge_method: dare_ties
	slices:
	- sources:
	- layer_range: [0, 22]
	model:
	model:
	path: NickyNicky/TinyDolphin-2.8-1.1b_oasst2_chatML_Cluster_1_V1
	- layer_range: [0, 22]
	model:
	model:
	path: NickyNicky/TinyDolphin-2.8-1.1b_oasst2_chatML_Cluster_1_V1
	parameters:
	density: 0.55
	weight: 0.55
	- layer_range: [0, 22]
	model:
	model:
	path: NickyNicky/TinyDolphin-2.8-1.1b_oasst2_chatML_Cluster_2_V1
	parameters:
	density: 0.55
	weight: 0.56
	- layer_range: [0, 22]
	model:
	model:
	path: NickyNicky/TinyDolphin-2.8-1.1b_oasst2_chatML_Cluster_3_V1
	parameters:
	density: 0.55
	weight: 0.56