Fix .htaccess since wordpress tries to overwrite it and duplicate the mod_rewrite declarations every time you touch the permalinks page