Spaces:

DanyaalMajid
/

NLP-Final-LocalLLM-RAG

Running

DanyaalMajid commited on Jan 8

Commit

4dc8cac

•

1 Parent(s): 5b00cc2

Update Path

Files changed (1) hide show

app.py CHANGED Viewed

@@ -30,7 +30,7 @@ def main():
     llm = LlamaCPP(
         model_url=None,  # We'll load locally.
         # Trying small version of an already small model
-        model_path='./Models/phi-2.Q4_K_M.gguf',
         temperature=0.1,
         max_new_tokens=512,
         context_window=2048,  # Phi-2 2K context window - this could be a limitation for RAG as it has to put the content into this context window

     llm = LlamaCPP(
         model_url=None,  # We'll load locally.
         # Trying small version of an already small model
+        model_path='models/phi-2.Q4_K_M.gguf',
         temperature=0.1,
         max_new_tokens=512,
         context_window=2048,  # Phi-2 2K context window - this could be a limitation for RAG as it has to put the content into this context window