Throw exception if we wait too long