Add hidden config to disable pin/unpin monitoring

Yeah. Question is how to reliably enable it for the tests that verify that the pinned/unpinned calls are invoked correctly.