Later Koleka was an important representative at the Congress of Lushnjë (28–31 January 1920) and was responsible for implementing many of its decisions. Koleka also played a key role as an organiser in the Vlora War against the Italians (June–September 1920). He was the Albanian government representative concerning the Himara question in 1921. He served as Minister of Public Works () in 1922 and 1924, respectively in the cabinets of Ahmet Zogolli and Shefqet Vërlaci.