code and data for modality annotation project