be a bit more clever about assigning to doc.annotation_types to try to improve performance