Spaces:

uwnlp

/

guanaco-playground-tgi

like 502

Running

Hey, so I'm using AWS Sagemaker to host this model (timdettmers/guanaco-33b-merged ), and then using AWS lambda to host this model in a serverless architecture and API gateway, which acts as a trigger to the lambda function.
After hosting the model in Sagemaker, I cloned this repo to my local computer, and changed the API_URL in the app.py to the endpoint where the model is hosted and ran the file.
I encountered the following error.

This is my lambda function:

Let me know how to solve this issue.
Thanks in advance!