Really remove those submodules