ipython/ipython — Issue #1411: ipcluster starts 8 engines "successfully" but Client only finds two
Author: reckoner
Created: 2012-02-18 00:05:54+00:00
State: open

With Python 2.6.2 on windows xp, I did

>ipcluster start -n 8

claims that engines have started successfully, but

In [1]: from IPython.parallel import Client
In [2]: rc=Client()
In [3]: rc.ids
Out[3]: [6, 7]

finds only two. I checked the process list and there are 10 python processes running.

After inspecting the logs it seems as if it is trying to start the engines and have them connect on **two** different ports, not necessarily the one that the ipcontroller is on and then ultimately timing out. By specifying the --port flag on both the ipengines and ipcontroller, I was able to work around this, but even so, doing something like:

rc = Client()
dv = rc[:]
dv.activate()
dv.block=True
dv['a']=10

causes it to hang (wait indefinitely). There is no error reported so I don't know what's going on here.

Any help appreciated.

Thanks!