Extra Dependency Property added. Was hoping this would fix the issue of the error. Didn't quite fix it.

The problem lies within XAML, and the order in which is refreshes. This forces the combobox displaying the contact, to actually show the combobox default option which is index 0 : empty. Binding made sure that the preferred contact was emptied.