Simplify code at a few places

Remove some duplicate checks,
and unnecessary errors.
Shouldn't we simply fail to anchor the annotations if we haven't scanned? Isn't it the responsibility of other code to re-anchor when, e.g., scan completes / pages lazy render / etc.

This seems like a side effect that shouldn't be triggered at this place.