LoneStriker
/

SnowLotus-10.7B-4.0bpw-h6-exl2

Text Generation

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

SnowLotus-10.7B-4.0bpw-h6-exl2 / mergekit_config.yml

LoneStriker's picture

Upload folder using huggingface_hub

282801f verified 5 months ago

raw history blame contribute delete

No virus

120 Bytes

	models:
	- model: ./FrostNymph
	merge_method: passthrough
	parameters:
	normalize: true
	int8_mask: true
	dtype: float16