Handle event layers that are toggled inactive to properly update