Parallel compile test

This PR is to parallelize the compilation phase of the unit tests. I got a 20s gain on my laptop.

There are other PRs that will result in a cache miss for the Dockerfile.
- #6520

I suggest we merge those around the same time to avoid any inconvenience :)

Ping @tianon @unclejack