File size: 451 Bytes
15eb3af |
1 2 3 4 5 6 |
This is a quantization of Yi-VL-34B and of the visual transformer. You currently need to apply this PR to make it work: https://github.com/ggerganov/llama.cpp/pull/5093 - this adds the additional normalization steps into the projection Yi-Vl-34B is prone to hallucinations, to me it appears like a rushed release. Something did not go right in training. However, while 6B was the 2nd worst llava-model I've tested, the 34B did show some strengths. |