Hmm, factor 20 is definitely too much; I'll see if I can rewrite it so it spends most time only when really needed.

(I'm afraid some of this are the effects of putting out the PR late at night...)