Gollan was born in Edinburgh, where he grew up and took his first job as a painter's apprentice. His first introduction to political activity was during the 1926 general strike when he helped distribute the papers of the strike committee. On International Workers' Day, 1 May, the following year he joined the and its youth wing the Young Communist League (YCL). He became a signwriter but his career was cut short in July 1931 when he was arrested for distributing anti-militarist leaflets. He had been organising soldiers to demand better rights and conditions, an activity for which he was sentenced to 6 months in Edinburgh prison. After a popular campaign calling for his release he was freed in January 1932 and began working for the party.