warden writes its own pidfile on startup

This ensures that when the DEA comes back up it can immediately talk to
Warden and reload its instances. Previously the pid file was written too
early, so potentially Warden wasn't actually even listening on the
socket, and hadn't reloaded its containers.

[#57361124]
runner: allow max_in_flight to be overridden
Bump src/dea_next

Bump cloudfoundry/dea_ng:
  Alex Suraci and Maria Shaldibina:
     save instance's start timestamp in snapshot ( Travis Success: https://travis-ci.org/cloudfoundry/dea_ng/builds/12436897 )
     update running version if included in dea.update ( Travis Unknown )
     Stop sending advertisements in response to USR1 ( Travis Unknown )
     load from snapshots again, snapshot staging tasks ( Travis Unknown )
Bump src/collector, src/hm9000

Bump cloudfoundry/collector:
  Onsi Fakhouri and Phan Le:
     added hm9000 handler ( Travis Success: https://travis-ci.org/cloudfoundry/collector/builds/12439881 )
Bump cloudfoundry/hm-workspace:
  Onsi Fakhouri and Phan Le:
     metrics server registers with collector and actually serves a varz endpoint; bump testing framework
Bump src/dea_next

Bump cloudfoundry/dea_ng:
  Alex Suraci:
     run instance validations before checking limits ( Travis Success: https://travis-ci.org/cloudfoundry/dea_ng/builds/12448870 )
Bump src/cloud_controller_ng, src/tests

Bump cloudfoundry/cloud_controller_ng:
  Mark Rushakoff and Sarah Chandler:
     Try to get more info when flaky test fails ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12444161 )
  Alex Suraci and Maria Shaldibina:
     fix test that asserted object quality ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12443628 )
     updating an app's routes sets a new version ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12438952 )
     send nil download URI if local blob doesn't exist ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12341889 )
  Elisabeth Hendrickson and Mark Rushakoff:
     Fix flaky test ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12437976 )
     Fail more descriptively when reaching an app missing condition ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12433025 )
     Log app guid on droplet upload ( Travis Unknown )
  Ruth Byers and Tim Labeeuw:
     First pass at making CC work in random order ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12428818 )
     Fix the CC red build ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12427578 )
  Jeff Schnitzer and Zach Robinson:
     Change error text on service broker auth failure. ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12394863 )
  Tim Labeeuw:
     Add the curl command to the api docs ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12344193 )
     Change the POST /v2/buildpacks/<guid>/bits to a PUT to match the app bits upload and since semantically we are replacing not adding the buildpack bits. ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12340990 )
  Julz Friedman and Tim Labeeuw:
     The bootstrap CSS should loaded with no scheme so that it works on http and https. ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12334293 )
     Correct the output when downloading a droplet or buildpack cache ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12334030 )
     Futher fixes to the api docs ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12333764 )
     Exclude the buildpacks which haven't been uploaded yet from the staging message ( Travis Unknown )
     Staging message admin buildpack list is ordered by priority ( Travis Unknown )
     Finish up adding fields to the api docs ( Travis Unknown )
     Don't autogenerate the fields documentation. We prob need a test that ensures all fields are included ( Travis Unknown )
  Ian Lesperance and Jeff Schnitzer:
     Make dashboard_url optional ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12298093 )
     Imports tags from v2 service broker catalog. ( Travis Unknown )
     Forward the broker error description, if present ( Travis Unknown )
     Abandon vcap-common ServiceGatewayClient. ( Travis Unknown )
     Verify request headers for all v2 client commands ( Travis Unknown )
  Cornelia Davis and Jimmy Da:
     Make syslog_drain_url optional ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12295325 )
  Mark Rushakoff and Ruth Byers:
     Clear database before apps api spec ( Travis Unknown )
     Remove stray print from test ( Travis Unknown )
     Admin buildpacks must have a key ( Travis Unknown )
  Casey McTaggart:
     Bump loggregator_emitter version ( Travis Unknown )
Bump cloudfoundry/vcap-yeti:
  Alex Suraci and Maria Shaldibina:
     Bump assets ( Travis Unknown )
     use PUT for uploading admin buildpack bits ( Travis Unknown )
  Elisabeth Hendrickson and Mark Rushakoff:
     Jenkins needs more time for the large app resource spec ( Travis Unknown )
  Johannes Tuchscherer:
     Reactivate loggregator assertions ( Travis Unknown )
Readd 'Fix loggregator multi-AZ proxying'
Bump src/cloud_controller_ng

Bump cloudfoundry/cloud_controller_ng:
  Sarah Chandler:
     Merge pull request #103 from cloudfoundry/fix-cc-staging-clobbering ( Travis started: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12498845 )
  Alex Suraci:
     fix clobbering app updates during staging ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/12498359 )
Bump src/hm9000

Bump cloudfoundry/hm-workspace:
  Onsi Fakhouri and Sarah Chandler:
     bump hm9000: metrics_server prints out user/pass/port; pulled out common app code ( Travis created: https://travis-ci.org/cloudfoundry/hm-workspace/builds/12530269 )
  Onsi Fakhouri and Phan Le:
     update to etcd v0.1.2 ( Travis Success: https://travis-ci.org/cloudfoundry/hm-workspace/builds/12443702 )
     add travis build to readme ( Travis Success: https://travis-ci.org/cloudfoundry/hm-workspace/builds/12441822 )
     add travis.yml for hm-workspace ( Travis Success: https://travis-ci.org/cloudfoundry/hm-workspace/builds/12441651 )
Robuster tests for loggregator

Signed-off-by: Stephan Hagemann <stephan@pivotallabs.com>
Bump src/dea_next, src/tests

Bump cloudfoundry/dea_ng:
  Maria Shaldibina and Mark Rushakoff:
     Log more to track down a flaky test ( Travis Success: https://travis-ci.org/cloudfoundry/dea_ng/builds/12541195 )
Bump cloudfoundry/vcap-yeti:
  Maria Shaldibina and Mark Rushakoff:
     Allow more time for large file spec ( Travis Unknown )
loggregator spec: ordering does matter with blueshell expectations

Signed-off-by: Matthew McNew <mmcnew@pivotallabs.com>
Bump src/tests

Bump cloudfoundry/vcap-yeti:
  Maria Shaldibina and Mark Rushakoff:
     Fix broken test ( Travis Unknown )
     Output zeros instead of random bytes to speed up test ( Travis Unknown )
Update the loggregator trafficcontroller to use the new hashing

Signed-off-by: Matthew McNew <mmcnew@pivotallabs.com>
Revert "Revert "Update the syslog_aggregator job to use vendor nats""

This reverts commit c6fae32f631fee8e453739099f43f9d7bd6a293d.
Bump yetis: apps cant reach loggregator machines

Signed-off-by: Stephan Hagemann <stephan@pivotallabs.com>
Revert "Revert "Revert "Update the syslog_aggregator job to use vendor nats"""

This reverts commit 8053bc96079db04c48c4eca92c1a14803802f660.
stop installing/packaging libcap2

this has been added to the stemcell

[finishes #57779980]
clean up cc config template

[#56835342]
remove pkg_utils, use bundle package

the nightmare is over

[#56835342]