neuralmagic
/

OpenHermes-2.5-Mistral-7B-pruned50

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

OpenHermes-2.5-Mistral-7B-pruned50 / recipe.yaml

mwitiderrick's picture

Upload folder using huggingface_hub

36c7d4e verified 5 months ago

raw history blame

No virus

234 Bytes

	test_stage:
	obcq_modifiers:
	SparseGPTModifier:
	sparsity: 0.5
	block_size: 128
	sequential_update: true
	quantize: false
	percdamp: 0.01
	mask_structure: 0:0
	targets: ['re:model.layers.\d*$']