added a updated crawler and started to use wget to download a whole site.