Fix bug where letter mode could still ask for number