Cleanup cruft that accumulates during provisioning

We install a lot of stuff, and some of it leaves things around that just waste space, but have no use whatsoever, increasing the size of the build image without any benefit.

This is WIP and attempts to remove what's not required by default.