slow_worker: reenable slow worker for the file cache

The file cache needs a slow worker or it will never run the cleanup code.  In
configurations with multiple server blocks, like jefftk.com, the rewrite
driver factory could cause a a segfault by deleting the slow worker when setting
up caches.  So this fixes #126.