Leverage on autoremove to remove packages that are only needed for building.
This makes the installation faster as we do not need to constantly install/uninstall packages.