Refuse to switch the PXE link to install if the host is ready

If the templates want to activate some components only during the build
but the host status is not changed from "ready" before issuing the "aq
pxeswitch --install" command, then the build may fail.

Addresses-Issue: Jira/AQUILON-611
runtests: Add a check for configured hostname.

In commit 5d27c4da several tests started relying on the hostname
as detected by the config defaults.  This broke tests on our Aurora
RHEL 4 systems where a shortname gets detected but the tests
are expecting a fully qualified name.

I knew this at the time.  I might even have documented it
somewhere, but this error still caught me when I hit it today.

This patch checks the value up front and provides guidance on
a workaround if a shortname is detected.

Reviewed-By: Gabor Gombas <Gabor.Gombas@morganstanley.com>
Extend uniops-l2 and spot server roles

Addresses-Issue: Jira/AQUILON-947
                 Jira/AQUILON-952

Reviewed-by: John Monteiro <John.Monteiro@morganstanley.com>
Include host_environment in personality plenary and protobufs

Addresses-Issue: Jira/AQUILON-959

Reviewed-By: John Monteiro <John.Monteiro@morganstanley.com>
Added ntp service to regression tests

Added 2 new tests to TestPrebindServer to bind ntp service to
server nyaqd1.ms.com and 2 tests to TestUnbindServer to unbind.

Addresses-Issue: Jira/AQUILON-950

Reviewed-By: Priya Joshi <Priya.Joshi@morganstanley.com>
Merge remote-tracking branches 'origin/for_next/ntpd-testsuite-fix', 'origin/for_next/protobuf_hostenv' and 'origin/for_next/auth_role_modifications'
show_request: Fix where newlines are added to log records.

The newlines should always have been added after each log record by
the server.  However, the original implementation had them added by
the client.

This worked as long as the client got the records one at a time,
which it generally did.  However, if there is a proxy in line
this may not be true.  Fix by having the client just write whatever
it gets and having the server insert the newlines in the correct spots.

Reviewed-By: Gabor Gombas <Gabor.Gombas@morganstanley.com>
config: Add a fallback for setting the default user variable.

If the USER environment variable does not exist, fall back to
checking the password database.  I don't remember why I didn't
use this method in the first place... maybe ease of testing
alternate configurations?

As a config option, this value is (still) not meant in any way,
shape, or form to be used for security.

Reviewed-By: Gabor Gombas <Gabor.Gombas@morganstanley.com>
Add a scale test that mimics some behavior from the bootserver.

This also generates some reconfigure requests, so it somewhat
mimics bootservers hammering aqd alongside a rack being rebuilt.
It is meant to be used on a cloned copy of production.

Reviewed-By: Gabor Gombas <Gabor.Gombas@morganstanley.com>
aq: Add no-half-close to the knc options.

If the server end of the knc connection dies, knc will close stdout on
the client side.  However, knc stays running.  When the aq client tries
to read stderr, it blocks.

Setting this option results in knc shutting down cleanly when the pipe
on the server side is no longer valid, which is the desired behavior.

Addresses-Issue: Jira/AQUILONAQD-295

Reviewed-By: Gabor Gombas <Gabor.Gombas@morganstanley.com>
Fixes to init plenary collections with the correct logger.

Reviewed-By: Gabor Gombas <Gabor.Gombas@morganstanley.com>
aq: Prettify error messages for connection timeout.

Extend the logic for catching knc error messages to include a timeout
in addition to a straight connection refused.

Reviewed-By: Gabor Gombas <Gabor.Gombas@morganstanley.com>
update_metacluster: Fix for plenary logger.

I think this command has much bigger problems when it comes to
the plenary handling...

Reviewed-By: Gabor Gombas <Gabor.Gombas@morganstanley.com>
Add namespace definitions to the DocBook files

Reviewed-By: Nathan.Dimmock@morganstanley.com
Add script to quality check the docbook documentation

If a command has documentation in DocBook format, compare the list of
options mentioned in the DocBook file and in input.xml, and complain if
the two lists do not match.

Reviewed-By: Nathan.Dimmock@morganstanley.com
Documentation updates

Stop using manifests. Generate command-line options for search_cluster
from the generic options, using XSL to add the cluster_ and member_
prefixes. Fix various issues found by the documentation checker script.

Reviewed-By: Nathan.Dimmock@morganstanley.com
Fix some option declarations

--reverse_order of search_audit and --generate of cat are flags, not
booleans. The documentation checker is now picky about these.

Reviewed-By: Nathan.Dimmock@morganstanley.com
Run documentation checks during the testsuite

The goal is to make sure obvious errors in the documentation are caught
before a new broker release is made.

Reviewed-By: Nathan.Dimmock@morganstanley.com
Fix dependencies of "make check" in doc/Makefile

Reviewed-By: Nathan.Dimmock@morganstanley.com
add aurora host now doesn't depend on 3rd party tool sys_loc

Addresses-Issue: Jira/AQUILONA-551

Summary: add aurora host command now looks up host location
from host's network location instead of calling sys_loc

Reviewed-By: Gabor Gombas <Gabor.Gombas@morganstanley.com>