Herzlich was born in Kirkwood, Missouri, the son of Barbara Read (born Martin), a former tennis player, and Sandon Mark Herzlich. His paternal grandfather's Ashkenazi Jewish family left Austria after the German annexation. His father was raised Jewish and converted to Protestantism when Herzlich was born. He has one sibling, younger brother Bradley Martin, who was a member of the football team at Brown University.