When adding votes, only count it if it's not already in the list