Sir James had joined them on the doorstep.
Sir James got together with them at the door.