On 25 August 1758 he led his army against Frederick the Great at the Battle of Zorndorf. The battle cost both sides heavy casualties. Afterwards, Fermor withdrew his forces eastwards. He was later relieved of his command and served as a subordinate to Pyotr Saltykov during 1759.