RuntimeError: weight model.layers.0.self_attn.q_proj.weight does not exist
#1
by
nickykay
- opened
I'm using the deployment script below which is the same as the one provided in the Deploy tab above but with a slightly different huggingface-llm version (1.0.3 instead of 1.1.0) to be compatible with the SageMaker Python SDK version I'm using (2.188.0).
Upon running the script, I'm get this error in CloudWatch: RuntimeError: weight model.layers.0.self_attn.q_proj.weight does not exist
How can this be resolved?