Huggingface.js documentation

Interface: QuantizationConfig

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Interface: QuantizationConfig

Properties

bits

Optional bits: number

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:352


load _ in _ 4bit

Optional load_in_4bit: boolean

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:353


load _ in _ 8bit

Optional load_in_8bit: boolean

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:354


modules _ to _ not _ convert

Optional modules_to_not_convert: string[]

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:351


quant _ method

Optional quant_method: string

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:350

< > Update on GitHub