make sure that we remove all shares refering to the same parent
only unshare user share if it was shared with the current user