'goal builddict' : generate .rst and .html, not just .rst

before: running 'goal builddict' generates a couple of .rst files which we then give to Sphinx

after: running 'goal builddict' generates those .rst files but also a couple of .html files which we then give to sitegen.

If/when sitegen's in good shape, it'd be good to get rid of the .rst-generating part.

Most of this change is in src/python/pants/backend/core/tasks/builddictionary.py , plus new html templates.

There are also changes to some docstrings:

I replaced some sphinx-rst-isms with docutil-rst-isms (which also work with Sphinx).

And I replaced some lost docstrings which I removed with the "inherit docstrings" change because I "knew" they'd be inherited from a superclass.

And added some docstrings which have been missing for a while which I noticed because increased scrutiny grrrrr.

Testing Done:
https://travis-ci.org/pantsbuild/pants/builds/36888156

Running sphinx on the generated .rst files now generates warnings :-(
I poked around 'em for a while, but eventually gave up.

Bugs closed: 529

Reviewed at https://rbcommons.com/s/twitter/r/1079/
Plumb new-style options into the Context.

Allows code to reference option values the new way.

Renamed the overloaded self.options in Command to self.old_options/self.new_options,
to avoid confusion. Previously these collided and the only reason it worked was that
self.options happened to be reset to the right one just before using it.

Change a single flag reference to use the new path, as proof that it works.

With this change we can not only register flags the new way but also reference the option
values the new way. Once everything is ported to use these, we can switch the parser to
the new one, and the transition will be complete.

Testing Done:
ci baking.

Reviewed at https://rbcommons.com/s/twitter/r/1102/
Merge remote-tracking branch 'pantsbuild/master'

Conflicts:
	src/python/pants/goal/context.py
Switch global option registration to the new options system.

Also fix a couple of small issues that arose while testing this.

Also switch the --graph option in list_goals to be read from the
new location, to verify that this all works together.

Note that add_global_options is still used when generating the
build dictionary, so we can't get rid of it yet. We'll do so
in a pending change.

Testing Done:
Ran ci.sh. Ran manual command lines to verify that flags still work.

Reviewed at https://rbcommons.com/s/twitter/r/1109/
Add transitive jar dependencies to depmap project info goal for intellij plugin.

Add transitive jar dependencies to depmap goal for Pants Intellij plugin

When creating projects using the plugin, the depmap showed direct dependencies for 3rdparty jar libraries.
This change add the trasitive dependency jars to the depmap output.
The transitive jars are required to correctly configure intellij modules.

Testing Done:
yes.

Added integration tests but need to verify the contents.

PR created here:
https://github.com/pantsbuild/pants/pull/626
{Coverage increased (+0.04%) when pulling 09790ec on add_transitive_jar_deps into ad7d09d on master.}

Locally tested
./pants tests/python/pants_test/tasks:depmap_integration

Reviewed at https://rbcommons.com/s/twitter/r/1047/