Load babel also for xelatex (polyglossia only leads to problems)