My wife's job provides us with an apartment. We want to buy a home to live in on weekends and when we retire.
Lenders do offer better terms to home-buyers who view the home as their primary residence.
They have found that when borrowers have financial trouble, they will struggle harder to save their primary residence than a vacation home, or a property held as an investment. Because you intend to retire to this home, that logic would apply in your case, even though in the short-term you plan to spend more time in the apartment. You need not make an issue of it. When you apply for the loan, you should simply state on your application that the home will be your primary residence. If you already owned a home, the lender would ask what you intended to do with it.