In 1793, the army assigned Gyulay to the Army of the Upper Rhine under the command of Dagobert von Wurmser. On 13 October that year, he led a brigade under Friedrich von Hotze in the First Battle of Wissembourg. In November, he held the village of Mertzwiller for three weeks in the face of French attacks during the Battle of Haguenau. This action earned him the Knight's Cross of the Military Order of Maria Theresa in 1794.