slave: Implement NOOP builds, use it in benchmark