Error while loading the model using safe tensors
#13
by
tasheer10
- opened
Getting the following error while executing the following code :
pipe = pipeline("text-generation", model="HuggingFaceH4/starchat-beta", torch_dtype=torch.bfloat16, device_map="auto")
Error:
File "/data/user/.local/lib/python3.8/site-packages/safetensors/torch.py", line 261, in load_file
result[k] = f.get_tensor(k)
RuntimeError: Viewing a tensor as a new dtype with a different number of bytes per element is not supported.