In April 1941, Poole was promoted to the temporary rank of brigadier. In June, he was transferred back to the 1st Division as brigadier to take command of the 2nd Infantry Brigade in Egypt. He saw active service with the brigade at Mersa Matruh, commanding 'Braforce' under the 2nd Division on the Egyptian frontier later in 1941, and then with the 1st Division on the Gazala Line from February to May 1942. He returned temporarily to South Africa as officer commanding Cape Fortress until rejoining his brigade at El Alamein in August 1942. There he commanded the brigade in the Second Battle of El Alamein in October–November 1942. He returned to South Africa as second-in-command of the 1st Division.