Bug 892528 - Integration tests for closing notifications

Looks like this also includes Bug 892530 code, which should land as part of pull request #11727