Rudimentary web crawler. Programmed in Java and using the Lucene api.