Make sure the builds actually fail