cjpais

/

llava-v1.6-34B-gguf

like 40

I used this script which is a hack

Some of the initial feedback from these quants is certainly less performance than true 1.6. Likely most of this is due to the script not handling image splitting and padding in the projector. Ongoing work is being done in this PR