Remove submodules, use `git clone` directly instead

It is not fun to constantly update commits.