Bug 966147 - Email Notification doesnt go away when I click on it

When our notification handler gets called, get all the notifications, and find the matching one, then manually close it.