Fix the code for Perl::Critic 1.118

Most of the cases are grabbing at the guts of Test::Builder, which is evil but
necessary, or of objects which don't have accessors.

ProhibitBitwiseOperators cannot be configured.  See rt.cpan.org 84750 for a possible fix.