Remove old click notification and response notification.