Add hidden config to disable pin/unpin monitoring

This isn't the only place this pattern is used. I'm explaining it to the reviewer, so they can recognise it when they see it elsewhere. Then I don't have to repeat myself every time I do this.