Revert "filecache-worker: hook the worker up to the filecache"

This is causing segfaults on jefftk.com.

This reverts commit 6f927897ec7917939399f1a508499bd6ad47c18d.