TrOCR deployment in production

#6
by CristianJD - opened

Hi, anyone know how to make the inferece time using TrOCR fastest as possible, i deploy it using docker in Openshift but it's too low, i already using ONNIX format but i can't do a quantizing , because is not implemented yet in Vision-Encoder-Decoder

Sign up or log in to comment