Do not call refresh when removing indicators