[nemo-qml-plugin-contacts] Allow remove duplicate numbers without Person object

Adds one commit on top of: https://github.com/nemomobile/nemo-qml-plugin-contacts/pull/80