In mid-December 1944, Herenčić was promoted to the rank of general and in mid-March 1945, he was appointed commander of the newly formed 5th Ustaše Corps. Herenčić, along with two other generals, Vladimir Metikoš and Vjekoslav Servatzy, led the withdrawal of the Croatian Armed Forces towards Austria with the goal of surrendering to the advancing British. Once the lead elements of the fleeing columns reached Bleiburg just across the Austrian border on 14 May 1945 they were stopped by the British 38th (Irish) Infantry Brigade, commanded by Brigadier Patrick T.D. Scott. Herenčić, together with Metikoš, Servatzy and Danijel Crljen met with Scott who decided that the NDH troops and the civilians accompanying them should not advance any further. On 15 May, Herenčić, Metikoš, Servatzy and Crljen, representing the retreating NDH forces, met with Scott and the Partisan representatives, Milan Basta and Ivan Kovačić-Efenka. During this meeting, it was decided that the NDH forces would have to surrender to the Partisans.