scripts should be executable
shebangs
better jenkins status messages
test status code, highlights missing fields and common munge errors
fixed shape of decc.csv, number of corrupted commas
validate_csv layout
validate_csv checks for gov.uk, badly. Also, no need to trim urls
ditched concept of Whole Tag from validate_csv
refactored url validation
cleaned decc.csv using validate_csv.pl