有没有quantization_kernels.c和quantization_kernels_parallel.c文件下载
#43
by
haaaaaaaa1
- opened
用 chatglm-6b的这俩C文件编译后生成了.so文件使用，提示
FileNotFoundError: Could not find module 'C:\Users\Administrator.cache\huggingface\modules\transformers_modules\chatglm2-6b-int4\quantization_kernels_parallel.so' (or one of its dependencies). Try using the full path with constructor syntax.
提示了这个，还是运行成功了，但是超慢