Goldmann was captured by the British Army following the Battle of Monte Cassino, and sent to a POW camp in Morocco, and then later in French Algeria. On 24 June 1944, he was ordained a priest in the church of Notre Dame de Rivet, near the POW camp in Algeria. From August 1944 until the end of 1945, he served as a chaplain in a camp at Ksar es Souk, Morocco. According to Goldmann's memoirs, many of the inmates at Ksar es Souk remained convinced Nazis and therefore regarded their chaplain as a traitor. They falsely accused him of being the former commandant of Dachau concentration camp, alleging that he had attempted to escape prosecution by becoming a priest.