Spaces:

awais009
/

SQLGPT

Sleeping

awais009 commited on Aug 23

Commit

eea8e3d

•

1 Parent(s): 9466107

setted the n_threads

Files changed (1) hide show

main.py CHANGED Viewed

@@ -7,7 +7,7 @@ import logging
 llm = Llama(
     model_path="./quantized_model/sql_gpt_quantized.gguf",
     n_ctx=512,
-    n_threads=4,
     n_gpu_layers=-1
 )

 llm = Llama(
     model_path="./quantized_model/sql_gpt_quantized.gguf",
     n_ctx=512,
+    n_threads=1,
     n_gpu_layers=-1
 )