[CS] Don't run benchmarks when starting guard