neuralmagic
/

Nous-Hermes-2-Yi-34B-pruned2.4

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Nous-Hermes-2-Yi-34B-pruned2.4 / recipe.yaml

mwitiderrick's picture

Upload folder using huggingface_hub

0af8278 verified 5 months ago

raw history blame contribute delete

No virus

236 Bytes

	test_stage:
	obcq_modifiers:
	SparseGPTModifier:
	sparsity: 0.5
	block_size: 128
	sequential_update: true
	quantize: false
	percdamp: 0.01
	mask_structure: '2:4'
	targets: ['re:model.layers.\d*$']