dfm/emcee — Issue #16: multiprocessing using more resources than expected.
Author: dfm
Created: 2012-03-09 21:07:05+00:00
State: open

Dan Weisz (UW) says:

> I have a question for you about the proper usage of the 'threads' keyword.
> From your write up, my interpretation was that if I say set 'threads=5', it
> would use 5 processors. But that doesn't seem to be what is happening.
> Morgan and I share a 32-core machine, and I ran some code with 'threads=5'
> and 30 walkers, and it seemed to eat up more than 5 processors worth of
> resources. So, perhaps I'm doing something wrong? Or maybe I also have to
> provide a pool object?

His interpretation is right and in my experience this should work well. I'm not sure what the answer is to is problem. Any thoughts?