Adds settings panel with remove-ignored functionality