Do a pre-emptive check that the source path exists.

Probably weren't any problems with this, but just in case it's better
to do an explicit check rather than relying on the fact that it tries
to edit the config and cannot find it.