After the German invasion of the Soviet Union in 1941, Rall was given important tasks in the defence and evacuation of Soviet forces. He commanded the rearguard during the Soviet evacuation of Tallinn, during which the evacuation convoys suffered heavy losses due to mines. Rall's flagship was sunk and he suffered severe injuries. After a month recovering in hospital, he was well enough to resume command, and helped to direct the naval defences during the siege of Leningrad, and subsequent offensive operations as the Germans were pushed back. Receiving several awards for his service, Rall returned to academic life after the war, and wrote a number of military and historical texts before his death in 1948.