fix: removing some security groups from SRP

This patch default security group creation to false for mongodb, nfs,
spluknk, vayacondios, and zabbix. It is a response to a problem
creating too many security group rules in VCD.

From now on, all machines in a realm should be given access to the
control cluster by default.

Change-Id: I1e31b0f8091e6c1f91882edbfc9a38bc003c554f
feature: adding hortonworks hadoop plugins

These plugins add support for Hortonworks 2 (HDP2 or HWX2). This
cookbook, used in conjunction with the associated hadoop_hwx
cookbook in ironfan-enterprise, will be incorporated into the SRP.
This plugin is largely influenced by the hadoop plugin.
It provides plugins to create master (namenode, secondarynn,
and resourcemaster) as well as worker (datanode and nodemanager)
daemons on the appropriate machines.

Squashed commit of the following:

commit 9ba7fe11d904c671d1c038273a78f58c2b3389cc
Author: Eric Katerman <eric@infochimps.com>
Date:   Tue Mar 4 20:40:43 2014 -0800

    adding hadoop_hwx plugins

    Change-Id: I27363081b4e4d5b3daa069165668ea1ea2fc4e82

Change-Id: Iae864ef54cd8c6aeb82ee6084430081a56cc5280
fix: transitive plugin versions

The ironfan-plugins gem pulls in the plugin gems, each of which is
versioned independently. Previously, the 1.0.0 version of the
ironfan-plugins gem pulled in the 1.0.0 version of each plugin gem.

For each plugin, the ironfan-plugins gem now pulls in the version of
that plugins specified in its version.rb. This change also bumps the
version of the ironfan-plugins gem to 1.1.0.

Change-Id: I50d0c2c3d2c1c4d8bec4f17df9a94ce117bf6e15
feature: adding ipaclient plugin to ironfan plugins

Squashed commit of the following:

commit 84532c68a87c2f513616e82e7695322084bcfb2d
Author: Chris Howe <howech@infochimps.com>
Date:   Thu Mar 6 10:00:00 2014 -0600

    Forgot to load the ipaclient plugin

commit 50a12b12a6ffae6d1e31b5dcb30d5d4441285e73
Author: Chris Howe <howech@infochimps.com>
Date:   Thu Mar 6 09:52:33 2014 -0600

    Added an ipaclient plugin. It takes three settings from Chef::Config:

      ipaclient_nss_password:    the password ipaclient will use to bind to
                                 the ipa ldap

      ipaclient_admin_principal: the username of the admin account to use
                                 when adding machines to the domain

      ipaclient_admin_secret:    the password for the above account

    These setting can be made in knife/credentials/knife.org for a given
    customer - and in general one should create a new admin account for each
    customer, and either disable the account or change the password after
    the srp is set up.

Change-Id: I6a010f71894fd0aaf30e88af6dfc0e9acfe7635d
fix: adding bundle/ to .gitignore

Change-Id: Ia725d274c57845e0436ff4d609f03bb165842ff8
Merge "feature: adding ipaclient plugin to ironfan plugins"
fix: modifying hadoop_hwx_s3_keys plugin and adding `rake build` artifacts

Addresses two issues:

1) roles are being replaced by plugins, so removing the hadoop_s3_role from
   the hadoop_hwx_s3_keys plugin

2) ip_hadoop_hwx.gemspec, as well as hadoop_hwx entries in lib/ironfan/plugins.rb,
   were missing, causing 'missing method' errors when running knife commands

Squashed commit of the following:

commit d817a3ed2be0f2d400080b5cad2b486eb747ad4c
Author: Eric Katerman <eric@infochimps.com>
Date:   Thu Mar 6 12:52:17 2014 -0800

    adding artifacts from `bundle exec rake build`

    Change-Id: I78bdbda969a27b96339315bd51f0ef9023fdb60a

commit 32efc58ee52c917bb6a1340e2c456d8f81c78443
Author: Eric Katerman <eric@infochimps.com>
Date:   Thu Mar 6 12:51:15 2014 -0800

    replacing hadoop_s3_keys role in hadoop_hwx_s3_keys

    Change-Id: I9ed3acf862eeb362492747c035b8e2b3531faccf

Change-Id: I435cdbeb3763c22139cf666358f21b7301f1bd9b
Merge "fix: transitive plugin versions"
fix: hadoop_hwx_s3_keys uses proper override syntax

This fixes a 'method_missing' error that may be generated whenever
hadoop_hwx_s3_keys was invoked

Squashed commit of the following:

commit 270990b94501624183d2d4412575d1347ee9257b
Author: Eric Katerman <eric@infochimps.com>
Date:   Fri Mar 7 14:43:36 2014 -0800

    fixing a 'method_missing' error

    Change-Id: Ia347723ab6051bea0bc0947aa5701cda0b36c6a6

Change-Id: I08829c8a6e5f179f1abf968a61f8e3f6fa58ce30
fix: adding explicit maven role to storm_nimbus plugin

Addresses https://www.pivotaltracker.com/story/show/67136458

Squashed commit of the following:

commit 0aa5233b02af12f6abfbdb682418fdd55647b6ed
Author: Eric Katerman <eric@infochimps.com>
Date:   Sat Mar 8 23:02:54 2014 -0800

    adding explicit maven role to storm_nimbus plugin

    Change-Id: Icd10e2a23752861a7908a73fc60785f5c1d9dd74

Change-Id: I98703fb57084faa03de62753cd0815c40be0ca65
feature: added openstack support

Squashed commit of the following:

commit 78a3ff441e6d466f314a311de67f656e97c5640d
Merge: f57a0c3 ba14e5b
Author: Chris Howe <howech@infochimps.com>
Date:   Mon Mar 10 13:49:43 2014 -0500

    Merge branch 'howechupdate' into 20140310-feature-openstack-support

    Conflicts:
    	plugins/cluster_util/lib/ironfan/plugins/cluster_util/component/with_systemwide.rb
    	plugins/dashpot/lib/ironfan/plugins/dashpot/component/dashpot_server.rb
    	plugins/nfs/lib/ironfan/plugins/nfs/component/nfs_server.rb
    	plugins/zabbix/lib/ironfan/plugins/zabbix/component/zabbix_server.rb
    	plugins/zookeeper/lib/ironfan/plugins/zookeeper/component/zookeeper_server.rb

commit ba14e5b73d50e9a4b4ed0d7edb66d74597267e27
Author: Chris Howe <howech@infochimps.com>
Date:   Mon Mar 10 13:40:39 2014 -0500

    removed offending comments

commit 43f10fecd645c9ad6b1592cfe92ca677de7a2eed
Author: Chris Howe <howech@infochimps.com>
Date:   Mon Jan 27 13:38:03 2014 -0600

    fixed up nfs group

commit 9a130c7612261002d18b13f4e3d56e1f54da833e
Author: Chris Howe <howech@infochimps.com>
Date:   Mon Jan 27 13:31:43 2014 -0600

    removed cloud specific informaton

commit 3da1a14c79c9edbb236c2749bf2d580f85358506
Author: Erik Mackdanz <erik@infochimps.com>
Date:   Wed Jan 15 11:29:48 2014 -0600

    Factor out selected_cloud until it works reliably

commit 3695390de5e4df204323f18237e3500045ff5d4b
Author: Erik Mackdanz <erik@infochimps.com>
Date:   Tue Jan 14 13:35:16 2014 -0600

    NFS server accepts clients correctly for the current cloud

Change-Id: I2f9816c3e4d8bb8fdc86b65cf577013c2fbe0391
Gems should not have Gemfile.lock

Change-Id: I47c30342ed8a602a94300f5484023478fde27d2e
feature: adding nginx reverse proxy with basic auth flag to http listeners in srp

This is an update of the recent hotfix made for TV; we put nginx in front of http
listener apps on each http listener node, and we allow for enabling http basic
auth (username/password auth).

1. nginx has been added as a reverse proxy (default is from port 80 to port 8080)
   and in the future may be used for local load balancing as well (e.g. port 80
   to multiple [netty] apps on 8080, 8081, 8082)

2. nginx is deployed and configured via chef/ironfan/ironfan-plugins, and the http
   listeners are activated by tachyon as before

3. to enable basic_auth, just uncomment the appropriate lines in
   knife/credentials/knife-org.rb and flip the flag passed to the kafka_http_listener
   ironfan-plugin in your cluster definition

This is a coordinated update and involves modifications (on branches of the same feature/
review name) in the following repos:

infochimps-labs/ironfan-pantry
infochimps/enterprise-homebase
infochimps/enterprise-credentials
infochimps/srp-deploy
infochimps/ironfan-plugins

This has been tested against current master branches (with minor modifications, notably
using the stable branch of vayacondios) of the srp.

Squashed commit of the following:

commit 506f2f1ec6c945e2b90318519661949840cd67a0
Author: eric katerman <eric@infochimps.com>
Date:   Wed Feb 5 16:43:05 2014 -0800

    adding kafka_http_listener plugin and making some minor bugfixes

    Change-Id: I5162e9948fa1e34fc9801aaf378bc9fa8f8961f3

Change-Id: I8464ec962c3a197b4f851111869d57414be2bec0
Merge "feature: added openstack support"
feature: configurable reuse jvm times option for hadoop

In addition to making mapred.job.reuse.jvm.num.tasks configurable,
this patch refactors the hadoop classes. The hadoop datanode,
jobtracker, namenode, secondarynn, and tasktracker plugins are all now
subclasses of the hadoop daemon plugin. That plugins provides the
ability to customize that hadoop parameter.

Change-Id: I82ae83d9fa31848e1a19c9db26d09c4c3d034ef1
fix: move Ironfan dependency to gemspec from Gemfile

Change-Id: Icad28859f9d0313ac875ed1f2745bf99ca6df290
Merge "fix: move Ironfan dependency to gemspec from Gemfile"
feature: data volumes configurable on hadoop components

Previously, due to some problems passing around model fields, it
wasn't really possible to turn data and log volumes off for Hadoop
clusters without a hack. This change makes the hack unnecessary.

Change-Id: Idd84d5e47ca8f11ae197e63b6f5b2b68cad6e2e1
Merge "fix: adding bundle/ to .gitignore"
Merge changes Idd84d5e4,I82ae83d9

* changes:
  feature: data volumes configurable on hadoop components
  feature: configurable reuse jvm times option for hadoop