At least 22 Islamists were arrested in overnight raids as Bangladesh strengthened security nationwide on Saturday after authorities hanged six top Muslim militants, police said.