Don't endlessly refresh pillars in multi-master

Closes #13187
Merge pull request #13547 from cachedout/13187

Don't endlessly refresh pillars in multi-master