Remove the retry logic

I think the zhm at least lets us punt this one.