Add UI for editing ignores (fixes #502)

Feel free to suggest better texts/messages, as I am usually pretty bad at it.