runtime error
Exit code: 1. Reason: /usr/local/lib/python3.10/site-packages/pydantic/_internal/_fields.py:161: UserWarning: Field "model_id" has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`. warnings.warn( CUDA non disponibile. Utilizzando CPU. Traceback (most recent call last): File "/home/user/app/app.py", line 599, in <module> main() File "/home/user/app/app.py", line 141, in main llm = setLLM() File "/home/user/app/utils.py", line 48, in setLLM llm = HuggingFaceLLM( File "/usr/local/lib/python3.10/site-packages/llama_index/llms/huggingface/base.py", line 237, in __init__ self._model = model or AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3376, in from_pretrained hf_quantizer.validate_environment( File "/usr/local/lib/python3.10/site-packages/transformers/quantizers/quantizer_bnb_4bit.py", line 62, in validate_environment raise RuntimeError("No GPU found. A GPU is needed for quantization.") RuntimeError: No GPU found. A GPU is needed for quantization.
Container logs:
Fetching error logs...