Contestants don't need to remember all the letters that have been called. Offstage there is a "Used Letter Board" that shows them what's already been guessed.