VRAM requirement
2
#5 opened 28 days ago
by
jithinmukundan
Can VLLM be used for loading?
6
#4 opened about 1 month ago
by
wawoshashi
How many bits and what is the groupsize?
1
#3 opened about 1 month ago
by
vitvit
What library was used to quantize the model?
1
#2 opened about 2 months ago
by
KirillR
How to load command r+ in text-generation-webui?
5
#1 opened about 2 months ago
by
MLDataScientist