During the German invasion of Poland in September 1939, Goldberg managed to escape to the city of Białystok, which was occupied by the Soviet Union. He lived there during the Soviet occupation and worked in zincography. After the occupation of Bialystok by the Germans in 1941 he was interned in the Białystok Ghetto. There he was in charge of the drawing of the Judenrat's formal posters, which were made in an elegant paintings and hanged on the Council's Building.