Ignore dirty submodules for fontconfig and libexpat