neuralmagic
/

Nous-Hermes-2-Yi-34B-pruned50

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Nous-Hermes-2-Yi-34B-pruned50 / recipe.yaml

mwitiderrick's picture

Upload folder using huggingface_hub

12cc552 verified 5 months ago

raw history blame contribute delete

No virus

234 Bytes

	test_stage:
	obcq_modifiers:
	SparseGPTModifier:
	sparsity: 0.5
	block_size: 128
	sequential_update: true
	quantize: false
	percdamp: 0.01
	mask_structure: 0:0
	targets: ['re:model.layers.\d+$']