Fix openstack logging issues for debug, use stderr for default logging

- There are stdout logging related bugs exist in openstack services, thus
  as a workaround, stderr logging should be used for non syslog mode (option 1)
- Log config for stdout logging provided as well but now configured to be used
- Because of some issues with logdir/log_dir logfile/log_file typos, use both

TODO fix init scripts to redirect stderr to logfiles and
to not use explicit logfile/logdir/logconfig in daemon launch string

Implements (partially): #FUEL-835, Option 1

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>

Conflicts:
	deployment/puppet/quantum/manifests/init.pp

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add puppet-logstash module from Apollo11 team, Poland

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Fix packages for libzmq1

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Extend jarfile to package provider for logstash

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add puppet module for elasticsearch

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add logstash port parameter to listen onto

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add InputFileReadMode for rsyslog::imfile

Default 0, line based

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add openstack::logfilter class for logstash

- Install and configure logstash, elasticsearch, kibana by its templates (default is fuel node)
- Provide rsyslog client sided templates for logstash remote logging as well as rsyslog ones
- Assume logstash defaults fuel:55514, udp - for anaconda logs capturing
(thus, logstash non-defaults should not be used for now)
- Use paragraph based message detection for rabbitmq (imfile)
- Use user facility and line based (default) message detection for openstack DEBUG (imfile)
- Ensure new logfiles introduced for logstash and elasticsearch are rotated

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Del config template for elasticsearch

Remove double declaration, delegate templating to openstack::logfilter

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Skip paramedic plugin for elasticsearch

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add cluster_name for elasticsearch, fix templates

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Change firewall rules for logstash

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Rename tag for non aplha numerical program names

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Send anaconda logs to logstash as well

Assume logstash node is fuel:55514, udp

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Add grok tags for rfc5424 (bootstrap/anaconda)

Fix rfc3164 pattern to make simicolon optional

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Revert "Fix openstack logging issues for debug, use stderr for default logging"

This reverts commit 08780aae7599f86328c2734210e8b550f8a258b4.

Conflicts:
	deployment/puppet/rsyslog/manifests/client.pp

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Fix grok pattern for debug case

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Fix kibana service and notification

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Restore class var debug were missed

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>
Extend rfc5424 grok pattern to match hostnames in message

Signed-off-by: Bogdan Dobrelya <bogdando@mail.ru>