Use astropy-helpers, if available, for the Astropy docs theme.  Looks quite nice, but I made it optional for now so that building the tutorials doesn't break for anyone who doesn't have astropy-helpers available