Sphinx-enabled web crawler