Check that migrations folder exists. If not, exit gracefully instead of throwing NPE