Revert "build-with-colors: moar colors"

This reverts commit f354e7bc8119361e18074d4072f54d43a0cbaa82.