Norman was born in Adelaide and left school at 13. He worked as a labourer until he enlisted in the Second Australian Imperial Force's 2/10th Battalion in 1939 at the outbreak of World War II. He served in England, Tobruk, New Guinea and Borneo, where he was mentioned in dispatches for bravery in action as a signaller. After the war he worked on the docks in Port Adelaide and became a leader of the Waterside Workers' Federation and president of the Trades and Labor Council in 1964.