This Is A Very Resource effective 13b vicuna model!
#1
by
Aito48
- opened
I have gone trough a great trouble to be able to run a good vicuna 13b model in my PC and finally I found it, it is this model.
Running well in my PC with this specs and I can still do alot of another stuff while this great and personal AI is running.
My specs currently.
Win11
AMD Ryzen 7 5700X 8-Core Processor 3.60 GHz
Kingston 16GB (2 x 8GB) FURY Renegade, DDR4 3600MHz, CL16
Asus TUF GAMING B550-PLUS, ATX
Asus RTX 2070 8gig of VRAM
Kingston 1TB NV2 PCIe 4.0 NVMe SSD M.2
Using the latest oobabooga.
I am really happy about this model, works well with pre_layer setupping.