Phillips attended East High School in Salt Lake City, where he was involved in the arts and plays. He served in the United States Army for three years in the 1950s. Witnessing the devastation of post-war Korea greatly influenced his social and political thinking. After discharge from the army, Phillips rode the railroads, and wrote songs.