Just say the index is at `docs/_build/html/index.html`.  Presumably people can figure out how to open an HTML file on disk in their web browser of choice, so then you don't need the next code-block.