'use_cache' in model config

#1
by fuvty - opened

Dear authors. I am using the model and notice that use_cache in model config is set to False. It seems to cause the generation phase to be very slow. Is there a particular reason for that. Thanks a lot.

Large Model Systems Organization org

Thanks for reporting this. It has been fixed.

lmzheng changed discussion status to closed

Sign up or log in to comment