saiga-api-cuda-internal

Runtime error

muryshev commited on Dec 1, 2023

Commit

4a96a57

•

1 Parent(s): 29df98b

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -21,7 +21,7 @@ ROLE_TOKENS = {
     "system": SYSTEM_TOKEN
 }
-CONTEXT_SIZE = 4000
 ENABLE_GPU = True
 GPU_LAYERS = 70

     "system": SYSTEM_TOKEN
 }
+CONTEXT_SIZE = 2000
 ENABLE_GPU = True
 GPU_LAYERS = 70