Validate reference path before cloning

Ignoring the user-configured reference path upon failure is
a source of hard-to-track problems.

This change validates the reference path in the context of
the clone, treating relative paths correctly.