Use guesses to keep track of counts