infochimps/cluster_chef — Issue #69: Limit on how much data can be sent to a newly bootstrapped node?
Author: pcn
Created: 2011-11-09 15:41:21+00:00
State: open

/Users/pn/gems/gems/excon-0.6.6/lib/excon/connection.rb:190:in `request': RequestLimitExceeded => Request limit exceeded. (Fog::Service::Error)

I get this trying to launch a cluster of 18 nodes after adding this hack to chef, to send an encrypted data bag secret:

https://github.com/pcn/chef/commit/953170fa2cdc1df33a159745f4fb9f1de9578442

"description"=>"cluster_chef generated group PNTestCluster"}, @cloud=#>, "ssh"=>#}}>>}}>, @cluster=#, @fullname="PNTestCluster-knewdle-0">}>}, @fog_servers= , @aws_instance_hash={}>, @fullname="PNTestCluster-web_proxy-0">
WARNING:
18/18 |**************************************************| 1:55
/Users/pn/gems/gems/excon-0.6.6/lib/excon/connection.rb:190:in `request': RequestLimitExceeded => Request limit exceeded. (Fog::Service::Error)
from /Users/pn/gems/gems/chef-0.10.4/lib/chef/knife/core/bootstrap_context.rb:54:in `join'
from /Users/pn/gems/gems/chef-0.10.4/lib/chef/knife/core/bootstrap_context.rb:54:in `to_proc'
from /Users/pn/.chef/plugins/knife/knife_common.rb:109:in `each'
from /Users/pn/.chef/plugins/knife/knife_common.rb:109:in `progressbar_for_threads'
from /Users/pn/.chef/plugins/knife/cluster_launch.rb:99:in `run'
from /Users/pn/gems/gems/chef-0.10.4/lib/chef/knife.rb:391:in `run_with_pretty_exceptions'
from /Users/pn/gems/gems/chef-0.10.4/lib/chef/knife.rb:166:in `run'
from /Users/pn/gems/gems/chef-0.10.4/lib/chef/application/knife.rb:128:in `run'
from /Users/pn/gems/gems/chef-0.10.4/bin/knife:25
from /Users/pn/gems/bin/knife:19:in `load'
from /Users/pn/gems/bin/knife:19

How has the amount of data being sent to clients changed recently? What is the limit I'm running into?

Thanks,

-Peter