Patterson was a veteran of World War II, at 24 attaining the rank of major. He was a paratrooper with the 82nd Airborne Division. He made 16 parachute jumps, including into Normandy, and fought with General James M. Gavin in the Battle of the Bulge. The 82nd Airborne was one of the first American occupying troops in Berlin; Patterson was appointed Division Provost Marshal for Berlin by General Gavin, who later played an important part in integrating the Army.