He became Kosovo's first post-war Prime Minister from 2002 to 2004. After the 1999 conflict, he served as first Interim Mayor of Mitrovica Municipality. He was also a founding member of the Democratic Party of Kosovo (PDK). It was during his premiership that Kosovo's first Provisional Institutions of Self-Government were established. As a member of the presidency of the Democratic Party of Kosovo, Dr. Rexhepi is responsible for international relations and European Integration. His advice was sought regularly during the final status negotiations brokered by UN Special Envoy Martti Ahtisaari. In November 2007, he was elected Mayor of Mitrovica, a highly complex city effectively divided into an UN-administered North part of the city and an Albanian-majority South. In recognition of his political experience, he was also elected President of the Association of Kosovo Municipalities.