Note to self: we must really improve the SH generation in SciPy to be more efficient.  Currently, if you ask for one, all are generated.