Józewski actively supported Józef Piłsudski's May 1926 "Coup d'État". In its aftermath he returned to politics, in August 1927 becoming a member of the government. In December 1928 he became voivode of Wołyń Voivodship. From December 29, 1929, to March 17, 1930, and again from March 29, 1930, to June 3, 1930, he served as Minister of Internal Affairs, then resumed his post as voivode of Wołyń. In 1923 he was decorated with the "Virtuti Militari", and in 1929 with the "Polonia Restituta".