LoneStriker
/

SnowLotus-10.7B-3.0bpw-h6-exl2

Text Generation

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

SnowLotus-10.7B-3.0bpw-h6-exl2 / mergekit_config.yml

LoneStriker's picture

Upload folder using huggingface_hub

cd8591c verified 10 months ago

120 Bytes

	models:
	- model: ./FrostNymph
	merge_method: passthrough
	parameters:
	normalize: true
	int8_mask: true
	dtype: float16