zpn's picture TheBloke's picture
Update to set use_cache: True which can boost inference performance a fair bit (#1)
8e4f7bb