Introduce clock job (overloaded cloud_controller_ng)

* There should be only 1 clock per deployment
* Chose to overload cloud_controller_ng job to avoid duplication
* Set ccng.process_group to cloud_controller or clock
  * Former is the default
  * Latter runs only the clock process

[#62482050]

Signed-off-by: Abhijit Hiremagalur <abhi@pivotallabs.com>
Merge tag 'v153'
Usable quota for open source cloud operator.

Signed-off-by: Phan Le <ple@pivotallabs.com>
Add new console client

* Remove unused portal and billing clients
Merge pull request #251 from cloudfoundry/new_console_client

Add new console UAA client
Remove billing UAA client

No longer in use by frontend team. Cleaning it up.
Raw SQL and request params can be sent to NewRelic

  * disabled by default
  * stubs enable obfuscated SQL collection but not reuest params
Bump src/cloud_controller_ng

Bump cloudfoundry/cloud_controller_ng:
  Dave Liebreich:
     Update newrelic_rpm gem ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15911000 )
  Ruth Byers:
     Default quota reloads from database every time ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15910094 )
  Eric Malm:
     Avoid using @@class variables ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15909955 )
     Move DropletUpload job into Jobs::Runtime and drop suffix ( Travis Unknown )
     Move DropletDelete job into Jobs::Runtime and drop suffix ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15903086 )
  Abhijit Hiremagalur:
     Move ModelDeletion job into Jobs::Runtime and drop suffix ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15908983 )
     Fix require, update should be upload ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15906151 )
     Make jobs require in the same order on OSX and Linux ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15905965 )
     Move BlobstoreUpload && BlobstoreDelete into Jobs::Runtime ( Travis Unknown )
     Rename spec to match class name. ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15902264 )
     Properly namespace AppBitsPacker job and avoid suffix ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15901961 )
     Move model spec to correct location ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15899818 )
  Maria Shaldibina:
     Re-enable one_to_many modifying collection tests ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15907008 )
  Alex Choi, achoi:
     Fix the default quota definition missing in configuration ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15902283 )
ability to switch between gnatsd and ruby nats
Bump src/gnatsd

Bump apcera/gnatsd:
  Derek Collison:
     Need to flush the clients ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/15371636 )
     go fmt fix ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/15370771 )
     1.2 only ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/15370594 )
     go vet fixes for 1.2 ( Travis Unknown )
     fixup for change to go vet ( Travis finished: https://travis-ci.org/apcera/gnatsd/builds/15369607 )
     Clean up after ourselves ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/15369077 )
     fix for race in test ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/15368501 )
     Move to https for git clone ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/15367409 )
     travis fixups ( Travis finished: https://travis-ci.org/apcera/gnatsd/builds/15367264 )
     Added in go get directive ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/15366572 )
     Fixed slice panic on MSG_ARG split buffer ( Travis Failed: https://travis-ci.org/apcera/gnatsd/builds/15365922 )
     Bumped version ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/15248823 )
     Removed setting the Read or Write Buffers. ( Travis Unknown )
     Use shortcut ( Travis Success: https://travis-ci.org/apcera/gnatsd/builds/14171365 )
Add src_alt to .gitignore

  * place code here to override the default src/ when testing

Signed-off-by: Aram Price <aprice@pivotallabs.com>
Cleanup Gemfile bosh_cli is now in rubygems

Signed-off-by: Aram Price <aprice@pivotallabs.com>
Remove convenience script

  * this doesn't belong in a release repo

Signed-off-by: Aram Price <aprice@pivotallabs.com>
Remove obsolete whats_in_the_deploy.rb script

  * Generate this document with git-release-notes gem

[#62741596]

Signed-off-by: Aram Price <aprice@pivotallabs.com>
Bump src/cloud_controller_ng

Bump cloudfoundry/cloud_controller_ng:
  Phan Le:
     Make cutoff_age_in_days for AppEvent and AppUsageEvent configurable ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15942797 )
     Turn Clock into a class so its easier to inject dependencies ( Travis Unknown )
     Reorganize specs by job ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15940227 )
     Make AppUsageEventsCleanup and AppEventsCleanup consistent ( Travis Unknown )
     Schedule to clean up old app events. ( Travis Unknown )
     Introduce AppEventsCleanup to cleanup old events ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15939300 )
  Eric Malm:
     Inject prune threshold into AppUsageEventCleanup job ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15939696 )
     Delete app usage events older than 31 days ( Travis Unknown )
     Introduce AppUsageEventsCleanup and enqueue to run once a day ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15912827 )
  Dave Liebreich:
     Update nokogiri to latest ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15913231 )
     Update rake gem ( Travis Unknown )
     Update :test gem group ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15912641 )

[Finishes #62823112] [Finishes #62482050]

Signed-off-by: Phan Le <ple@pivotallabs.com>
Bump src/warden

Bump cloudfoundry/warden:
  Alex Choi, achoi:
     Move the checks for number of connections into setup_grace_timer ( Travis Success: https://travis-ci.org/cloudfoundry/warden/builds/15914250 )
     Register container grace timers on warden restart ( Travis Success: https://travis-ci.org/cloudfoundry/warden/builds/15913130 )
  Maria Shaldibina:
     Register the client with all containers on reconnect ( Travis Unknown )
Adding tsdb properties to the cf-jobs stub

Signed-off-by: Abhijit Hiremagalur <abhi@pivotallabs.com>
Signed-off-by: Eric Malm <emalm@pivotallabs.com>
Bump src/cloud_controller_ng, src/dea_next

Bump cloudfoundry/cloud_controller_ng:
  Maria Shaldibina:
     Log when the app is deleted ( Travis Failed: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/16051775 )
     Log the changes on app update ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/16050939 )
  David Varvel, Jimmy Da and Lucas Marks:
     Provide a better error message for duplicate plans ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/16044797 )
  Phan Le:
     Move back to published talentbox-delayed_job_sequel ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15945976 )
     Reduce duplication and split complex method ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/15944446 )
Bump cloudfoundry/dea_ng:
  Maria Shaldibina:
     Log instance index when registering/unregistering instance ( Travis Success: https://travis-ci.org/cloudfoundry/dea_ng/builds/16051456 )
  Aram Price:
     Remove rspec monkey patch ( Travis Success: https://travis-ci.org/cloudfoundry/dea_ng/builds/15946413 )
     Remove TODOs ( Travis Unknown )
     Update rubyzip gem (:test group) ( Travis Failed: https://travis-ci.org/cloudfoundry/dea_ng/builds/15945722 )
     Use ruby 1.9 hashes ( Travis Unknown )
Remove misleading whitespace

Signed-off-by: Eric Malm <emalm@pivotallabs.com>
Bump src/gorouter/src/github.com/cloudfoundry/gorouter

Bump cloudfoundry/gorouter:
  Abhijit Hiremagalur:
     Move server.go into its own package ( Travis Success: https://travis-ci.org/cloudfoundry/gorouter/builds/16054176 )
  Eric Malm:
     Remove unused types in our fork of server.go ( Travis Success: https://travis-ci.org/cloudfoundry/gorouter/builds/16043717 )