Make Kubernetes startup less noisy

You should be able to check for os.IsNotFound() here