Failed to create LLM
#1
by
bannsec
- opened
This isn't loading with your ctransformers line for some reason.
RuntimeError: Failed to create LLM 'stablelm' from '/home/user/.cache/huggingface/hub/models--TheBloke--rocket-3B-GGUF/blobs/e442f3e149a4d6bc1732dd07e1c84ef9cb6183625920e67a43517b20783b9c71'.
bannsec
changed discussion title from
rocket-3b.Q5_K_M.gguf
to Failed to create LLM
This issue still persists