win10
/

Breeze-13B-32k-Base-v1_0

Text Generation

MediaTek-Research/Breeze-7B-32k-Base-v1_0

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Breeze-13B-32k-Base-v1_0 / mergekit_config.yml

win10's picture

Upload folder using huggingface_hub

562d547 verified 5 months ago

1.28 kB


	dtype: bfloat16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 8]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- layer_range: [0, 8]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- sources:
	- layer_range: [4, 12]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- layer_range: [4, 12]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- sources:
	- layer_range: [8, 16]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- layer_range: [8, 16]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- sources:
	- layer_range: [12, 20]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- layer_range: [12, 20]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- sources:
	- layer_range: [16, 24]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- layer_range: [16, 24]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- sources:
	- layer_range: [20, 28]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- layer_range: [20, 28]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- sources:
	- layer_range: [24, 32]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
	- layer_range: [24, 32]
	model: MediaTek-Research/Breeze-7B-32k-Base-v1_0