Improve validation tools

To use test.py in gating jobs, two options have been added that
set default values. That way, we can have in the Jenkins files
only the master switch and can control ourselves if we want to
change what exactly is run as part of such a gate job.

For validation we do not recurse the whole tree anymore
if we only validate single files.

A verbose mode has been added.
Each pass shows now the number of files processed and only outputs
filenames if --verbose is given.
Additionally, formatting has been cleaned up by using pylint and pep8.
pep8 reports no warnings or errors now.

Example outputs of test.py:
$ tools/test.py --job-niceness

Validating files...
  config-reference/ch_networkingconfigure.xml: trailing or unnecessary
whitespaces found in lines: 13
...
Validation failed, validated 14 files.

$ tools/test.py --job-build

Checking that no removed files are referenced...
Passed removed file check, 41 files were removed, 627 files checked.

Validating files...
Validation passed, validated 14 files.

Queuing the following books for building:
  config-reference
  install-guide
  admin-guide-network
Building all books now...
>>> Build of book admin-guide-network succeeded.
>>> Build of book install-guide succeeded.
>>> Build of book config-reference succeeded.

Change-Id: Ia443553b6c774df7e72ef7c0d8768badfb34bc6d
Clean up heat CLI section

bug: #1216909

Change-Id: I9d21aaabeb70e2669fd1728da52a7ad335a105ee
author: diane fleming
Move install and config info from Network Admin Guide to Install Guide and Config Ref

Applied systemitem and programlisting tags where indicated by reviewers
Deleted extra spaces after =s and also other white spaces
Fixed a couple of typos - major copyedit to be done under another bug

Closes-bug: 1223542
Change-Id: Ia4ecbdb304e18a42769b50d52d33e3757710fe5b
Author: Nermina Miller
Merge "Move install and config info from Network Admin Guide to Install Guide and Config Ref"
Merge "Clean up heat CLI section"
Merge "Improve validation tools"