Sir James had joined them on the doorstep.
Sir James excused himself to answer a phonecall before rejoining them near the door.
mnli hypothesis: Sir James excused himself to answer a phonecall before rejoining them near the door. premise: Sir James had joined them on the doorstep.