Removing cached submodule pieces