Remove observer of particular notification only