Can I run this model with transformers 4.36 and vllm 0.2.7?

by nxphi47 - opened Feb 6

Feb 6

I saw the architecture is Qwen2, how is it different from qwen-1 ?

Can I use vllm to run it and not updating to 4.37 to run it?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment