in bog validator, need to handle duplicates and recounts