Ignore infinite similarities in normalizers.