Refactor conference contact

I would rather no introduce a third way of handling attributes we have to merge...