Flan-t5-XL and 500 server error
Hello. I have a Docker with fastapi and uvicorn. It is a simple example based on the example here on hugging face. In order to load the large model, flan-t5-large, I had to run on hugging face, e.g. I was running locally where the webserver became unresponsive when trying to load large.
So on Hugging Face, large loads, XL looks like it's loaded or loading, but then I get a 500 server error from hugging face while testing the UI. Any advice is appreciated ... one of the things I did to get XL to seemingly load was to update the version of the transformers library to 4.25.1. However, still no joy from hugging face in my UI.
I have facing the same issue ... hugging face Endpoint not working . Time out Error. I am using This by Langchain. From 9th April Its stop working. Every time when I'm testing I got a 500 server error from hugging face.
On hugging face website it's shows Model not loaded yet.
Any advice is appreciated