Add puppet module for logstash

This is a verbatim copy of upstream
https://github.com/elasticsearch/puppet-logstash
v0.5.1 e972df79eaa7a0399e56e1173d49a4dcdb9ca7be

Partial-blueprint: logstash-elasticsearch-kibana-for-logs

Change-Id: I4e85576ce0930238450488607987a4d7518edb1f
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
Add puppet module for logstash

This is a verbatim copy of upstream
https://github.com/elasticsearch/puppet-logstash
v0.4.3 aa9646f35f192321e06fe81e951848fe43ca5587

Partial-blueprint: logstash-elasticsearch-kibana-for-logs

Change-Id: I4e85576ce0930238450488607987a4d7518edb1f
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
Add puppet module for elasticsearch

This is a verbatim copy of
original source 'https://github.com/electrical/puppet-elasticsearch'
v 0.1.2 0d4870880e2420f249fa4cbb6227d8ac030029c3

Partial-blueprint: logstash-elasticsearch-kibana-for-logs

Change-Id: I00f7c32ef0a8d822cbaae64e9ffa01ff7a3275b2
Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
Add puppet-logstash module

This is a verbatim copy of
original source 'https://github.com/electrical/puppet-logstash'
v0.3.2 6a82bf82121a7d2c0124c24512eb0081d1a16bc2

Partial-blueprint: logstash-elasticsearch-kibana-for-logs

Change-Id: I4e85576ce0930238450488607987a4d7518edb1f
Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
Edit puppet-logstash module

Changes:
- Fix packages for libzmq1
- Extend jarfile to package provider for logstash
Apollo11 changes:
412499b - Bartosz Kupidura, 9 months ago : Heap_size as a parameter for logstash/init.pp
21abbc7 - Bartosz Kupidura, 9 months ago : Logstash module for PP

Partial-blueprint: logstash-elasticsearch-kibana-for-logs

Change-Id: I4e85576ce0930238450488607987a4d7518edb1f
Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
Add InputFileReadMode for rsyslog::imfile

Default 0, line based

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add openstack::logfilter class for logstash

- Install and configure logstash, elasticsearch, kibana by its templates (default is fuel node)
- Provide rsyslog client sided templates for logstash remote logging as well as rsyslog ones
- Assume logstash defaults fuel:55514, udp - for anaconda logs capturing
(thus, logstash non-defaults should not be used for now)
- Use paragraph based message detection for rabbitmq (imfile)
- Use user facility and line based (default) message detection for openstack DEBUG (imfile)
- Ensure new logfiles introduced for logstash and elasticsearch are rotated

Change-Id: Ib5931dc38181d157dd4c6cff68cbd57fd14a643d
Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Signed-off-by: Bogdan Dobrelya <bdobrelia@mirantis.com>
Del config template for elasticsearch

Remove double declaration, delegate templating to openstack::logfilter

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Skip paramedic plugin for elasticsearch

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add cluster_name for elasticsearch, fix templates

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Change firewall rules for logstash

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Rename tag for non aplha numerical program names

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Send anaconda logs to logstash as well

Assume logstash node is fuel:55514, udp

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add grok tags for rfc5424 (bootstrap/anaconda)

Fix rfc3164 pattern to make simicolon optional

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Fix grok pattern for debug case

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Fix kibana service and notification

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Restore class var debug were missed

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Extend rfc5424 grok pattern to match hostnames in message

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Fox config requirements and services notifications for logfilter

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Assume base syslog node (fuel master) is also logstash node

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>