Remove HumanLangListeners' references when switching exercises