Revert "Build all architectures"

This reverts commit 1e0e39bcabbe134d0ae11fe1ad2bd46b6adeb722.