Ah .. that makes sense :-( 

I read over the slow_worker code, and noticed that the destructor of the factory calls shutdown unconditionally on the slow_worker. Maybe we should put a NULL check in there as well? It should be an impossible condition, but it would make it more robust to changes (e.g. if someone wants to make a LRU only cache setup possible later on, no slow_worker would be required)