"I'm not implying anything.  I'm simply saying that Smith has been through quite a lot and is not used to high-level ceremony.  He'll sleep sounder here, where he feels at home.  And so shall I.  I am a crochety old man, sir, and I prefer my own bed.  Or I might point out that our talks may break down and my client and I would be forced to look elsewhere - in which case I would find it embarrassing to be a guest under your roof."