Something is causing seg fault
#1
by
kajuberdut
- opened
So I can load another 70b Q4_K_M.gguf just fine, for example: Successfully loaded chronos-70b-v2.Q4_K_M.gguf
But, if I use the exact same layers/tensor_split, I just change the model in the dropdown, see The settings for orca_llama_70b_qlora.Q4_K_M.gguf have been updated, and then click 'load", I get: ..........................................................Segmentation fault (core dumped)