Halevi was drafted into the IDF in 1985. He volunteered as a paratrooper in the Paratroopers Brigade. He served as a soldier and a squad leader. In 1987 he became an infantry officer after completing Officer Candidate School and return to the Paratroopers Brigade as a platoon leader. Halevi led the Brigade's Anti-tank company in counter-guerrilla operations in South Lebanon. Afterwards he was assigned to Sayeret Matkal, the IDF's special forces unit, where he served as a company commander. Halevi later commanded Sayeret Matkal, during the Second Intifada. His next command was the Menashe Regional Brigade. During Operation Cast Lead Halevi commanded the 35th Paratroopers Brigade. He later commanded the 91st Division.