I don't believe that throwing an exception out of here will actually fail anything.

Fwiw, I think we should maintain a count of how often this happens and emit it as a metric