Uses old style debugs for url filters instead of backward-compat style.
url.py: Caches the parsed URLInfos.
__main__.py: Hooks in pdb.
web.py: Breaks loop if robots.txt is error with mock robots.txt entry.