Added scripts to remove duplicates, ensure URL unique index, and fix the random numbers\nTotally needs to get these integrated into one script