He was born in Philadelphia where his father was an estate agent, but he did not live there for very long since when he was only three years old his family moved to New York. Sam's father had a good income from being an estate agent and the family were well off.
Siya ay ipinanganak sa Philadelphia kung saan ang kanyang ama ay isang estate agent, ngunit siya ay hindi nakatira doon para sa napaka-haba dahil kapag siya ay lamang ng tatlong taong gulang sa kanyang pamilya inilipat sa New York. Sam's ama nagkaroon ng isang magandang kita mula sa pagiging isang estate agent at ang pamilya ay well off.