Golden first attended Harvard College, where he received a degree in art history. Then he went to Columbia University for his Master's degree in Japanese history, primarily focusing on Japanese art.