Fix Ignore Module warning

Ignore list label was destroyed when removed, giving a warning when
closing the Ignore Window.