Cancel notications before unpersisting