His parents were Dr. Algernon Sidney Porter (1825–88), a physician, and Mary Jane Virginia Swaim Porter (1833–65).
Njegovo srednje ime je bilo ob rojstvu Sidney, a si ga je leta 1898 spremenil v Sydney.