munge annotations into an object form