> Or perhaps, add a assert_all_equal utility to sklearn.utils.testing ?

No. Let us keep a bound on the number of small helper utilities.