react-native-executorch-spec / precisions.json
msluszniak's picture
Add a16w8, the QNN 16-bit-activation / 8-bit-weight precision
3d77f0b
Raw History Blame Contribute Delete
577 Bytes
{
"$schema": "https://huggingface.co/software-mansion/react-native-executorch-spec/resolve/main/config.schema.json#/$defs/precisions",
"description": "Authoritative partition of precision tokens used in react-native-executorch model file names. A variant is quantized iff its precision token is listed under `quantized`. Configs do not repeat this; derive it from here.",
"quantized": [
"4w",
"8da4w",
"8da8w",
"a16w8",
"a8w8",
"int4",
"int8",
"qat_lora",
"spinquant"
],
"non_quantized": [
"bf16",
"fp16",
"fp32"
]
}