I know the config system is going away long term, but this seems like a great opportunity for a config option to set the URL to the docs.  i.e., you install them locally, add the location to your config file, and forget it.  Bonus points for adding a function "download_docs" that would download the corresponding docs tree to somewhere within `site-packages/astropy` and then adds the correct configuration.