Option added to persist crawl cache.
Documention added for static cache.