Delay setting up XDM socket so we get any user-configured settings