more data tidying and validating