runtime error

│ │ │ ) │ │ 487 │ │ raise ValueError( │ │ │ │ /home/user/.local/lib/python3.8/site-packages/transformers/modeling_utils.py │ │ :2819 in from_pretrained │ │ │ │ 2816 │ │ │ │ │ key: device_map[key] for key in device_map.keys() │ │ 2817 │ │ │ │ } │ │ 2818 │ │ │ │ if "cpu" in device_map_without_lm_head.values() or "d │ │ ❱ 2819 │ │ │ │ │ raise ValueError( │ │ 2820 │ │ │ │ │ │ """ │ │ 2821 │ │ │ │ │ │ Some modules are dispatched on the CPU or the │ │ 2822 │ │ │ │ │ │ the quantized model. If you want to dispatch │ ╰──────────────────────────────────────────────────────────────────────────────╯ ValueError: Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model. If you want to dispatch the model on the CPU or the disk while keeping these modules in 32-bit, you need to set `load_in_8bit_fp32_cpu_offload=True` and pass a custom `device_map` to `from_pretrained`. Check https://huggingface.co/docs/transformers/main/en/main_cl asses/quantization#offload-between-cpu-and-gpu for more details.

Container logs: