weezywitasneezy
/

OxytocinEngineering_v0-10B-passthrough

Text Generation

Sao10K/Fimbulvetr-11B-v2

KoboldAI/LLaMA2-13B-Tiefighter

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

OxytocinEngineering_v0-10B-passthrough / mergekit_config.yml

weezywitasneezy's picture

weezywitasneezy

Upload folder using huggingface_hub

c9c5b6c verified 8 months ago

214 Bytes


	slices:
	- sources:
	- model: Sao10K/Fimbulvetr-11B-v2
	layer_range: [0, 32]
	- sources:
	- model: KoboldAI/LLaMA2-13B-Tiefighter
	layer_range: [24, 32]
	merge_method: passthrough
	dtype: bfloat16