ENH:  Adding capability of having a similarity metric per modality