Sentence:  No matter how early I came down, I would find him on the veranda, smoking cigarettes, or otherwise his man would be there with a message to say that his <WSD>master</WSD> would shortly join me if I would kindly wait. 
Meaning of the word marked with <WSD> tags:  Someone who employs others.