Sir James had joined them on the doorstep.
Sir James got together with them at the door. 
mnli hypothesis: Sir James got together with them at the door.  premise: Sir James had joined them on the doorstep.