[nemo-qml-plugin-contacts] Fix assert on empty phone numbers

Regression from 40bcd0aa. Also removes unused variable.