Coming from feedback from Caitlin (Madison). 
This is also a key information that users have already asked in the clients i.e. when you mouse over a tag linked to an object, you want to know the annotator more than the owner of the tag.