He was born in Fredericton, New Brunswick and grew up in Toronto, Winnipeg and Saskatoon, Saskatchewan. He served overseas with the South Saskatchewan Regiment during World War II and was wounded at Dieppe. After the war, Kohaly continued his studies at the University of Saskatchewan, receiving a law degree in 1950. He set up practice in Estevan. Kohaly was elected to the provincial assembly in a 1953 by-election held following the death of John Edward McCormack. After he was defeated when he ran for reelection in 1956, he returned to practising law. Kohaly served as president of the Saskatchewan branch and as national president of the Royal Canadian Legion.