Lru crawler

LRU crawler.

Background thread that (safely?) crawls stuff on demand.

Needs to be torture tested by mc-crusher before I merge. Just opening a pull-request against myself for shiggles.