Added initial crawler script. Can fetch the starting url and get the list of Link elements on the page and extract URLs from these.
Crawler now gets URLs and digs a certain number of levels down. More robust testing is needed to see if it can handle all types of URLs. Relative path URLs are automatically converted into absolute URLs.
Updated installation instructions
Updated installation instructions
Added support for storing keywords for each page, automatically generated from page content.