Migrated the validation code over from Scala Hadoop Shredder to this project