Temporary disabling pin and pebil benchmarks