Replace syslog forwarder with metron_agent in all jobs

[#79485730 #81035298]

Signed-off-by: Alex Stupakov <astupakov@pivotal.io>

Conflicts:
	jobs/cloud_controller_clock/spec
	jobs/cloud_controller_ng/spec
	jobs/cloud_controller_worker/spec
Removed logs jobs from all infrastructures

Also remove syslog_aggregator property from cf-jobs.yml

[#81035298]

Signed-off-by: Trevor Ackerman <tackerman@pivotal.io>
bump loggregator

f377f57 Update TC integration tests to use new verison of NOAA
57150e8 bump noaa
08319c9 Remove syslog_aggregator functionality from Metron job
a0266e3 make the trafficcontroller authorization cookie Secure!
ef950f8 bump noaa
5216a2a Describe multi-client firehose subscribers [#80870620]
a2e40a4 bump noaa
d9de82e readme text updated to match current architecture
36f924e bump noaa
52cc500 bump noaa
7752d8e Add firehose configuration and feature description to README.
59ff54f Increase test timeouts for travis
d20adf2 standardize interface of all firehose_group functions to take argument of type Sink
c257b2b rename doppler variables for clarity
941de04 generalize AppId and FirehoseSubscriptionId to StreamId
54b99d9 Fixes dea agent retry on closed unix socket
87cd1c6 firehose subscriber support in traffic controller and doppler
fc753c4 Merge branch 'set-cookie-endpoint' into develop
b7cea61 trafficcontroller requires subscription_id param on firehose endpoint
8493eab Send correct headers for CORS on TC /set-cookie endpoint
b79fbc9 bump noaa
3e4be9e Merge pull request #30 from mheath/log-appid-buffer-truncation
63830da Log more data for troubleshooting buffer truncations.
8080374 Set allow-origin to jsdemo for testing
78b1581 Add CORS headrs to set-cookie response
d489430 bump loggregator_consumer
4a951e0 bump noaa
9cd0bd6 Unescape post form values it CT set-cookie endpoint
2dcdbea Spike on /set-cookie
166fe50 Remove dependency on dropsonde/events to eliminate conflict with noaa
ef1e147 Ignore artifacts from `go get` of gorouter done by test
ba16a33 Fix refactor of makeDopplerProxy
de1c735 Fix race conditions in trafficcontroller tests
80187e2 Minor cleanup
9c29ca2 Remove now-defunct pending tests; refactor remaining tests to not hang
14ee3db Fix trafficcontroller handling of recent logs
4dc0f96 Add integration tests around recent logs
90225db bump noaa
98ec047 Move syslog_aggregator functionality into metron_agent job, and rename to syslog_daemon_config
2d80865 bump loggregatorlib
ba0edd2 Fix mistake in doppler.json.erb
cbe92a4 Use new collector registrar
d6bd599 Use new collector registrar
cafe0fb Use changes from latest version of loggregatorlib
f528b30 bump loggregatorlib
ef10c6d bump loggregatorlib
5709c07 bump noaa
6cb8ce3 Firehose endpoint in traffic controller.
d457eb1 bump noaa
623de26 Whitespace
4a295d5 Cleanup
08e2540 Increase polling intervals to give server breathing room on slow box
914e0dd Fix missing package in tests
6335a45 Extract GetAppId out of events package
16b40cf Make bin/test take argument
90bdd50 bump noaa
7d6e080 bump noaa
4266f01 Update Travis build to include go tip as allowed failure
8faf0a5 Update to latest yagnats
b0f4371 bump loggregator_consumer
4ec9abd bump noaa
d8df6bc bump loggregatorlib
75a4973 bump loggregatorlib
40b01f5 bump noaa
82c07cc Varz emits http counters
c909afa bump noaa
a4f43c7 Only use https urls for public repos
e5d5e9a install missing gnatsd dependency in bin/test
37ac71e use new collector registrar in metron
6caa4cc bump loggregatorlib
6c542a5 Bump libraries after moving NOAA
197b523 Add noaa submodule
a04bb01 bump loggregator_consumer
6975c1f Update to latest dropsonde and loggregatorlib
a6e5b52 Rename dropsonde_consumer to noaa
1abb3fe update metron to use simplified loggregator client pool
958f592 Update README.md
0ff2bb3 Use latest loggregatorlib
a8daedf Fix problem with tailing logs while scaling an app
45c4e23 Use new dropsonde/autowire/logs functionality to emit app logs
aefed7f bump dropsonde
Merging deployed version v191 to develop branch
Bringing in CC changes for brokers enabling upgrading service plans

[#79739820]
Add new login.notifications.url property.
- Enables sending of messages via notification service in login server when configured

[#77585328] https://www.pivotaltracker.com/story/show/77585328

Signed-off-by: Rob Gallagher <rgallagher@pivotallabs.com>
Add new login server scopes to default client in cf-release (notifications.write,critical_notifications.write, emails.write).

[#77585328] https://www.pivotaltracker.com/story/show/77585328

Signed-off-by: Madhura Bhave <mbhave@gopivotal.com>
Bump login-server and UAA to 1.9 release candidates
Bump Login Server and UAA to 1.9.0 Releases

Signed-off-by: Rob Gallagher <rgallagher@pivotallabs.com>
Ability to customize login server messages
https://www.pivotaltracker.com/story/show/71871918
This commit allows a new file to be configured
$CLOUD_COUNDRY_CONFIG_PATH/messages.properties
to contains custom messages for the login server.
This is useful when there is a need to display a description for a scope
during the OAuth user approval process of scopes/permissions
Bump src/smoke-tests and allow to skip smoke tests

- via bosh manifest, you can choose to skip some tests

Bump :
  Joseph Rodriguez:
     Increase timeout for cf logs --recent test
     Temporarily disable non-deterministic syslog drain tests so the cf-runtime pipeline is not artificially broken
  Eric Malm and Luan Santos:
     Add more explanation about what smoke tests are and when to run them
Allow login-server to be disabled via spiff templates
Bump src/cloud_controller_ng

Bump cloudfoundry/cloud_controller_ng:
  Michael Fraenkel:
     Pick a different name to prevent name pollution ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/39046211 )
     Pass along the droplet and build artifact uris ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/39025946 )
  Matthew Sykes:
     Finish the rename s/CF_DIEGO/DIEGO/g ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38962184 )
     update api version spec post-merge ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38950274 )
     backfill test for `stage_with_diego?` ( Travis Unknown )
     remove 'required' option for diego configs [#80165358] ( Travis Unknown )
  Johannes Petzold:
     don't force staging on diego when running on diego ( Travis Unknown )
     rename DIEGO_BETA -> DIEGO_STAGE_BETA [#80165358] ( Travis Unknown )
  Rick Reilly and Serguei Filimonov:
     Deprecate /v2/app_events ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38945989 )
  Chris Piraino and Eric Malm:
     Update copy bits API doc to make endpoint experimental ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38855006 )
Bump src/acceptance-tests, src/cloud_controller_ng

Bump :
  Chris Piraino, Luan Santos and Rick Reilly:
     Add CATS test for /v2/apps/:guid/copy_bits endpoint.
  Alex Stupakov:
     Add test for loggregator firehose [#80870620]
Bump cloudfoundry/cloud_controller_ng:
  Eric Malm and James Myers:
     Merge remote-tracking branch origin/wip-81201540 ( Travis started: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/39210027 )
     Update rspec gem ( Travis Unknown )
     /v2/apps/:guid/copy_bits is always async ( Travis Unknown )
  Matthew Sykes:
     Add index to worker name ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38863794 )
Bump src/cloud_controller_ng

Bump cloudfoundry/cloud_controller_ng:
  Chris Piraino and Serguei Filimonov:
     Avoid time zone and DST-related bugs by switching to Time.current. ( Travis started: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/39211623 )
Add hm9000.url properties to CF manifest

[#80850336]
Bump src/cloud_controller_ng, src/hm9000

Bump cloudfoundry/cloud_controller_ng:
  Jeff Hui and Luan Santos:
     Use only hm9000.url to set hm's url ( Travis created: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/39216835 )
  Dave Goddard and Luan Santos:
     Select hm9000 http schema ( Travis Unknown )
     Fallback to Deprecated HM9000 NATS Client if HTTP Server not found ( Travis Unknown )
     Replace HM9000 NATS client with HTTP ( Travis Unknown )
  Chris Piraino and Serguei Filimonov:
     Avoid time zone and DST-related bugs by switching to Time.current. ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/39211623 )
  Eric Malm and James Myers:
     Merge remote-tracking branch 'origin/wip-81201540' ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/39210027 )
     Update rspec gem ( Travis Unknown )
     /v2/apps/:guid/copy_bits is always async ( Travis Unknown )
     Update AWS s3 credentials for travis-ci ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38771837 )
  Michael Fraenkel:
     Pick a different name to prevent name pollution ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/39046211 )
     Pass along the droplet and build artifact uris ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/39025946 )
     Record a delete event after a successful delete ( Travis Unknown )
  Matthew Sykes:
     Finish the rename s/CF_DIEGO/DIEGO/g ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38962184 )
     update api version spec post-merge ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38950274 )
     backfill test for `stage_with_diego?` ( Travis Unknown )
     remove 'required' option for diego configs [#80165358] ( Travis Unknown )
     Add index to worker name ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38863794 )
  Johannes Petzold:
     don't force staging on diego when running on diego ( Travis Unknown )
     rename DIEGO_BETA -> DIEGO_STAGE_BETA [#80165358] ( Travis Unknown )
  Rick Reilly and Serguei Filimonov:
     Deprecate /v2/app_events ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38945989 )
     Merge remote-tracking branch 'origin/app_delete_event' [#80039456] ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38764282 )
  Chris Piraino and Eric Malm:
     Update copy bits API doc to make endpoint experimental ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38855006 )
  Andrew McNutt and Ruth Byers:
     Brokers must declare support in order to upgrade plans ( Travis Success: https://travis-ci.org/cloudfoundry/cloud_controller_ng/builds/38776234 )
Bump cloudfoundry/hm-workspace:
  Jeff Hui and Luan Santos:
     Bump HM9000 ( Travis Failed: https://travis-ci.org/cloudfoundry/hm-workspace/builds/39216737 )
     wip ( Travis Success: https://travis-ci.org/cloudfoundry/hm-workspace/builds/39213538 )
Fix manifest generation spec for warden
Bump src/hm9000

Bump cloudfoundry/hm-workspace:
  Jeff Hui and Luan Santos:
     Bump HM9000 ( Travis created: https://travis-ci.org/cloudfoundry/hm-workspace/builds/39218333 )
Allow setting cc loggin levels