Add the ability to temporarily silence a check.

RB_ID=452883