Saved a fairly ridiculous amount of CPU on unison-heavy patches...

I'd like to give a shout-out to GProf for discovering the excessive
CPU use of that function when supposedly inactive...