This is not likely to be a bottleneck until there are more than 10,000 annotations in a single doc :P