TI_RAG_Demo_L3.1

Runtime error

arjunanand13 commited on May 6

Commit

c277bbe

•

1 Parent(s): bad6153

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -56,7 +56,7 @@ model = transformers.AutoModelForCausalLM.from_pretrained(
             model_id,
             trust_remote_code=True,
             config=model_config,
-            quantization_config=bnb_config,
             token=HF_TOKEN,
             # use_auth_token=hf_auth
         )

             model_id,
             trust_remote_code=True,
             config=model_config,
+            # quantization_config=bnb_config,
             token=HF_TOKEN,
             # use_auth_token=hf_auth
         )