Interface: QuantizationConfig

Properties

bits

• Optional bits: number

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:685

---

config _ groups

• Optional config_groups: Record<string, { format?: string ; targets?: string[] ; weights?: { num_bits?: number } }>

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:690

---

format

• Optional format: string

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:689

---

ignore

• Optional ignore: string[]

compressed-tensors names its exclusion list ignore rather than modules_to_not_convert, using the same re:-prefixed target syntax as config_groups[].targets.

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:695

---

load _ in _ 4bit

• Optional load_in_4bit: boolean

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:686

---

load _ in _ 8bit

• Optional load_in_8bit: boolean

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:687

---

modules _ to _ not _ convert

• Optional modules_to_not_convert: string[]

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:684

---

quant _ method

• Optional quant_method: string

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:683

Update on GitHub