(#21817) Ignore duplicate certs

Previously, SSL connections initiated by the puppet agent on windows, e.g
puppet module install, would cause the agent to terminate if the 'Root' store
on Windows contained duplicate certificates.

This commit ensures that we only add unique certificates to the X509 store.
Also, if we fail to add a certificate to the store, we issue a warning and
continue.
(#22878) Scope call to CloseHandle

Previously, the win32-process gem used to extend Windows::Handle from the
windows-pr gem, so that the Process.CloseHandle method was available.
However, newer versions of the win32-process gem that are based on ffi, do
not extend Windows::Handle, so the Process.CloseHandle method is not defined.

This commit modifies puppet to call a version of CloseHandle which we
control, and therefore is guaranteed to exist.
Merge branch 'ticket/stable/22878-close-handle' into stable

* ticket/stable/22878-close-handle:
  (#22878) Scope call to CloseHandle
init: Check if running if not configured to start.

The reasoning for this is explained in:
https://projects.puppetlabs.com/issues/23033

Currently the init-script does not actually check if we're running and
return accordingly when status is called if the puppet master is not
configured to start.

This causes it to always return 0, meaning we're actually running
regardless of if that is the case.
(maint) Remove stale files from ext/rack

The ext/rack directory had an outdated README file and an ancient manifest.pp
file, and the useful files (config.ru and the example vhost) were buried in a
subdirectory.

This commit removes the old files, moves the good files up a level, and adds a
comment to the vhost pointing to the maintained passenger documentation.
(maint) Update debian packaging to reference new rack support location

As updated in commit 4c9b63f, the sample files for rack passenger deployment
have been moved up a directory. The puppetmaster-passenger package for debian
uses those files, so this commit updates the debian/rules file with their new
location. It also updates the README_DEVELOPER.md, which references the same
files.
Maint: Reformat docs for Augeas type's "changes" attribute

I'm trying to get DL elements out of the docs, and this fragment works better as
a more compact list anyway.
Maint: Reformat indirection reference to use H4s instead of DLs for termini

A long time ago, I shortsightedly decided to use the definition list Markdown
extension in some of our docs. Time and the renderer ecosystem haven't been kind
to that syntax, so we need to get away from them if we want to be able to switch
relatively freely between various MD processors.

This commit removes them from the last embedded documentation that we still use.
The old-style type reference still uses them, but since we've stopped relying on
it and moved to our own implementation, that should be fine.
(#22925) Fall back to cached catalog if we can't connect to the master

Prior to commit 093a0745b4, puppet would attempt to download a catalog, and if
that failed, it would apply a previously cached catalog. Note this
behavior is controlled by the `usecacheonfailure` setting, which is
disabled when using `--test`.

In commit 093a0745b4, the ENC was made authoritative for specifying node
environment. In doing so, the agent makes a REST call to the master for
its Node object, and then reads the environment from it.

However, the call is made in a begin/rescue block that only catches
Puppet::Error and Net::HTTPErrors, but not errors like
Errno::ECONNREFUSED, etc.

This commit ensures that any standard error will be caught when
retrieving the node's environment, as is done when retrieving the
catalog. If we fail to obtain the node's environment, we warn, and
continue trying to apply the catalog.

This commit does not try to fix consistency issues between the node and
catalog requests. For example, the node request could fail, resulting in
the agent requesting a catalog using its agent-configured environment.
The catalog request could succeed, resulting in the agent applying a
catalog from an environment that doesn't match what the ENC thinks it
should be.
(maint) Fix acceptance harness and tests for windows vcloud templates

Changes the git/pre-suite environment setup step to rely on the
puppet-win32-ruby repo for a windows specific build of ruby with the
gems we require.  Currently we are copying this directly into /bin and
/lib and resetting /lib/ruby for full permissions.  This is ugly, but
Josh and I were having trouble setting PATH in a global way through
Beaker.

This patch also fixes a win2008 bug in tests/ticket_15560_managehome.rb,
which I believe we never hit before because we have only been testing
aginst win2003, clears up a problem in the
resource/scheduled_task/should_query.rb being unable to run against
multiple agents, and patches the sslv2_downgrade_agent test to absorb
exit code 28 (timeouts) from the curl test, which are probably cropping
up occasionally on slow vms.  Kylo applied a similar fix for the 2.7.x
branch fa1e8e0
(#23074) Add reinventory command to puppet cert

This adds a reinventory command to the puppet cert application.

Further work on this is to refactor the use of the #apply method
found in Puppet::SSL::CertificateAuthority as it delegates to
a subclass called Interface to do the work. This is all an application
concern and it is confusing with the back and forth between the classes
"the cert application", the CA and its Interface.
(#23074) Add text to warn that master should be inactive for reinventory.
(#23074) Cleanup logic

This makes a couple of the methods in the CertificateAuthority and
related Interface classes easier to read / understand.
(#23074) Remove header in inventory.txt when regenerating

The regenerate inventory wrote a header that was not there in the
original file.
(#23074) Make cert inventory not rebuild inventory.txt when adding

There is a race condition that requires protection if the inventory
performs rebuild of a missing inventory.txt file when adding a cert.
Without the protection the inventory may end up with double entries or
missing entries, and with the protection the processing of cert requests
become serialized over all processors creating a performance problem.

This change simply appends to the inventory.txt - if the file does not
exists, it is atomically created.

A users that wants to recreate the inventory should do so with the
command `puppet cert reinventory` which may be executed on an
inactive system.
(#23074) Refactor cert application's use of cert authority's interface

The code was difficult to understand as the cert application called
the apply function on the CertAuthority, which in turned created an
instance of the Interface class, which in turn called back into the
ca. As this construct was only used by the cert application, the ca's
apply method was moved to the cert application.

It is now more clear that the application interacts with the ca via
an instance of its Interface class.
Merge pull request #2029 from jpartlow/maint/stable/acceptance-fixes-for-windows-vcloud

(maint) Fix acceptance harness and tests for windows vcloud templates
(#23074) Remove overly stubbed tests

There were several tests attempting to test the cert application,
the CertificateAuthority and its interface, as well as the inventory
handling by use of excessive stubbing that prevents any real code from
being tested.

The failing overly mocked tests have been removed. Their value was
questionable to begin with.
Merge remote-tracking branch 'upstream/stable'

* upstream/stable:
  (maint) Fix acceptance harness and tests for windows vcloud templates
  (#22878) Scope call to CloseHandle
Merge pull request #2031 from joshcooper/ticket/master/22925-cached-catalogs

(#22925) Fall back to cached catalog if we can't connect to the master