We should catch any exception as-is. We should also only delete if the call to publish did not throw.