Krumholtz was born in Queens, New York City. He is the son of Michael, a postal worker, and Judy Krumholtz, a dental assistant. He grew up in a “very working-class, almost poor”, Jewish family. His paternal grandparents had emigrated from Poland, and his mother moved from Hungary to the U.S. in 1956.