Shell and ruby scripts that crawle the web site.