[nemo-qml-plugin-contacts] Use fallback for primaryName only if secondaryName is empty

Otherwise the fallback is used unnecessarily when the display label ordering is reversed.