Revert "Allow "no overwrite" for config variables"

This reverts commit 4f6bcffce7040c7b71ba4c64b30e0068f59f0fa5.

It turns out we don't need this, so it should be deleted