Throw a human-friendly error if required file is missing

See #1485