vilm
/

vinallama-12.5b-chat-DUS

Text Generation

vilm/vinallama-7b-chat

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

vinallama-12.5b-chat-DUS / mergekit_config.yml

qnguyen3's picture

Upload folder using huggingface_hub

ac444da 6 months ago

raw history blame contribute delete

No virus

670 Bytes


	slices:
	- sources:
	- model: vilm/vinallama-7b-chat
	layer_range: [0, 16]
	- sources:
	- model: vilm/vinallama-7b-chat
	layer_range: [8, 16]
	- sources:
	- model: vilm/vinallama-7b-chat
	layer_range: [8, 16]
	- sources:
	- model: vilm/vinallama-7b-chat
	layer_range: [16, 24]
	- sources:
	- model: vilm/vinallama-7b-chat
	layer_range: [16, 24]
	- sources:
	- model: vilm/vinallama-7b-chat
	layer_range: [24, 28]
	- sources:
	- model: vilm/vinallama-7b-chat
	layer_range: [24, 28]
	- sources:
	- model: vilm/vinallama-7b-chat
	layer_range: [28, 32]
	merge_method: passthrough
	dtype: bfloat16