alpindale
/

c4ai-command-r-plus-GPTQ

VRAM requirement

by jithinmukundan - opened Apr 24

Apr 24

Can this run on an L40S GPU with 48 GB VRAM? I am using VLLM.

Apr 29

Nope.

Apr 29

What could be the minimum VRAM required?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment