Is the entire model quantized?
#8
by
gameveloster
- opened
Was the quantization performed on projector, vision tower and LLM? Or just on the LLM?
yes. all of it.
Was the quantization performed on projector, vision tower and LLM? Or just on the LLM?
yes. all of it.