Hard-line secularists accuse the AK Party of harboring a hidden Islamist agenda by seeking to ease restrictions on religion in public life , such as its failed attempt to ease a ban on Muslim headscarves at universities .