runtime error

Exit code: 1. Reason: A 97%|█████████▋| 59610/61520 [02:58<00:09, 207.49it/s] 97%|█████████▋| 59818/61520 [02:59<00:08, 196.62it/s] 98%|█████████▊| 60017/61520 [03:00<00:07, 197.12it/s] 98%|█████████▊| 60218/61520 [03:01<00:06, 197.87it/s] 98%|█████████▊| 60417/61520 [03:03<00:05, 196.26it/s] 99%|█████████▊| 60629/61520 [03:04<00:04, 200.58it/s] 99%|█████████▉| 60830/61520 [03:05<00:03, 200.09it/s] 99%|█████████▉| 61031/61520 [03:06<00:02, 199.08it/s] 100%|█████████▉| 61233/61520 [03:07<00:01, 199.94it/s] 100%|█████████▉| 61434/61520 [03:08<00:00, 198.89it/s] 100%|██████████| 61520/61520 [03:08<00:00, 326.23it/s] Converting and de-quantizing GGUF tensors...: 0%| | 0/291 [00:00<?, ?it/s] Converting and de-quantizing GGUF tensors...: 0%| | 0/291 [00:00<?, ?it/s] Traceback (most recent call last): File "/home/user/app/app.py", line 9, in <module> model = AutoModelForCausalLM.from_pretrained(model_id, gguf_file=filename) File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3705, in from_pretrained state_dict = load_gguf_checkpoint(gguf_path, return_tensors=True)["tensors"] File "/usr/local/lib/python3.10/site-packages/transformers/modeling_gguf_pytorch_utils.py", line 148, in load_gguf_checkpoint weights = load_dequant_gguf_tensor( File "/usr/local/lib/python3.10/site-packages/transformers/integrations/ggml.py", line 510, in load_dequant_gguf_tensor raise NotImplementedError( NotImplementedError: ggml_type 21 not implemented - please raise an issue on huggingface transformers: https://github.com/huggingface/transformers/issues/new/choose

Container logs: