Add submodules even when path is ignored or modified
Fix bug in deleting submodules for removed plugins