He was born in the New York City area, and was educated at Boston University and the Yale School of Art and Architecture. In his youth, he was heavily involved in the folk music scene, and in 1960 was married to celebrated folk singer Joan Baez's sister (they divorced a few years later). The couple lived for a time in the singer's home in Carmel, California.