> maybe it would be worth to have a discussion about it to be considered in
> scikit-learn.

This is really a nilearn question, not a scikit-learn question. Contrasts
have no meaning in scikit-learn. We are going to have to come up with our
own API here.