Can't there be a conflict in which both ends conflictingly delete the same contact?  In which case it will be in the local deleted list and also absent from the remote data set?