Remove submodules for now

Perhaps bring them back in in the tests/ directory where they are
actually needed. Will revisit when getting all that working again.