Don't update score until answer panels is shown