web_cralwer.py latest version

The find longest path appears to be working. But it requires further testing. Need to fix the prefix problem that it can go to an upper directory (it's not supposed to).