Cleaning of the data set based on the validation results.
Refactored many validation steps using data.table and some functions.