Have tried to create an inference point for this model couple of time and it failed on all occasions without any error. Here is the snippet of my log: What could be the issue? I'm using Nvidia A100 - 2xGPU.160GB. Have increased Max Number of Tokens to 8K.
