metadata
license: apache-2.0
GGUFs PLUS:
Q8 and Q6 GGUFs with critical parts of the model in F16 / Full precision.
File sizes will be slightly larger than standard, but should yeild higher quality results under all tasks and conditions.
license: apache-2.0
GGUFs PLUS:
Q8 and Q6 GGUFs with critical parts of the model in F16 / Full precision.
File sizes will be slightly larger than standard, but should yeild higher quality results under all tasks and conditions.