Use more granular libgit2 imports, don't clean every build

Saves maybe 10–15s per build on average. I tried a precompiled header as well, but that didn't seem to make any difference.