Fix only building active arch in debug.