The documentation page QUANTIZATION/GGUF doesn’t exist in v0.31.0, but exists on the main version. Click here to redirect to the main version of the documentation.