Revert "Set overwrite.cli.url configs on setup"

This reverts commit 48a1e69f5e803d61edcd7d083fd8e794f5bf194d.

This was backported too quickly.