In some cases that may be true, but if you need to reference Astropy in your docs don't you need Astropy installed too?  Or does the object index referenced by the intersphinx mapping just take care of all that?