Make reproducing result from the CI easier

Here are some patches that make easier to reproduce the results from the CI. Specifically supporting building identical binaries.