Kiszka's first military experience was during the Polish–Ottoman War (1485–1503). In 1497, King John I Albert organized an invasion of Moldavia. Lithuanians refused to join the campaign but Grand Duke Alexander sent a small force of volunteers and hired men commanded by Kiszka. The Polish forces were ambushed and defeated in the Battle of the Cosmin Forest.