HDFS-5673: validation and tests for duplicate entries.