Now when we load a bunch of annotations, first we do the virtual anchoring for all, and then in the second round, we do the physical anchoring for all (assuming that  the referenced pages are rendered.) This order makes some sense; but we could probably also do this on a per-annotation base. Unfortunately, I don't remember the reason for this design decision.

I will try the other way, and see if it messes up something.