If xdg home dirs are set, don't overwrite them