Józef was defeated at the battles of Kalisz 1706 and Koniecpol in 1708 and since 1709 after the Battle of Poltava he lived in exile in Hungary and Turkey. In 1714 he came back to Poland and became together with Teodor Potocki, the leader of the opposition to the "Familia" and the royal court. As part of this opposition, he contributed to the breaking-up of 9 sejms and prevented an increase of the army.