推理报错 [TM][ERROR] CUDA runtime error: invalid argument
#5
by
kkkknddnjfks
- opened
WARNING: Can not find tokenizer.json. It may take long time to initialize the tokenizer.
[WARNING] gemm_config.in is not found; using default GEMM algo
terminate called after throwing an instance of 'std::runtime_error'
what(): [TM][ERROR] CUDA runtime error: invalid argument /lmdeploy/src/turbomind/utils/allocator.h:253
Aborted
硬件A10，CUDA Version: 11.8
Please provide more details so that we can reproduce the error.