Spaces:

mobinln
/

chatbot

Running

mobinln commited on Aug 2

Commit

92f5c93

•

1 Parent(s): 99dac85

extend ctx to 4k

Files changed (1) hide show

app.py CHANGED Viewed

@@ -10,7 +10,7 @@ llm = Llama.from_pretrained(
     use_mlock=True,
     n_threads=2,
     n_threads_batch=2,
-    n_ctx=2000,
 )

     use_mlock=True,
     n_threads=2,
     n_threads_batch=2,
+    n_ctx=4000,
 )