Hardware

#6
by rileyjohnson - opened

What is the recommended hardware for this model?

RWKV org

3090 / 4090 (24gb vram) is recommended - otherwise you may want to consider quantized solutions using the rwkv pip library

Will a laptop with a GTX 1650 and 24GB of RAM be sufficient?

FWIW, I got an OOM error on my laptop with these specs:

13th Gen Intel(R) Core(TM) i9-13900H 2.60 GHz
32.0 GB RAM
RTX 4070

Sign up or log in to comment