replit-3b-ggml_models

Running

crystal99 commited on Jan 3

Commit

02c3bc7

•

1 Parent(s): b533356

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -53,7 +53,7 @@ generation_config = GenerationConfig(
     seed=42,
     reset=True,  # reset history (cache)
     stream=True,  # streaming per word/token
-    threads=int(os.cpu_count() / 16),  # adjust for your CPU
     stop=["<|endoftext|>"],
 )

     seed=42,
     reset=True,  # reset history (cache)
     stream=True,  # streaming per word/token
+    threads=int(os.cpu_count() / 6),  # adjust for your CPU
     stop=["<|endoftext|>"],
 )