QuietImpostor
/

Llama-3-Refueled-Pruned

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-3-Refueled-Pruned / mergekit_config.yml

QuietImpostor's picture

Upload folder using huggingface_hub

ff285d6 verified 6 months ago

217 Bytes

	slices:
	- sources:
	- model: refuelai/Llama-3-Refueled
	layer_range: [0, 19]
	- sources:
	- model: refuelai/Llama-3-Refueled
	layer_range: [29, 32]

	merge_method: passthrough
	dtype: bfloat16