When a request is stopped still make sure to try and cancel() the notification in case that path doesn't quite get hit