Hi so I wanted to add two model used in this space to Inference Endpoints and I wanted to know what is the process?
like did you make 2 separate endpoint? since your script is using just one endpoint how does that work? also did you use any custom handler?
Depending on how big the models are you could create a single endpoint with a customer handler see: https://www.philschmid.de/multi-model-inference-endpoints
The attached blog posts shows you how you can do this