Fix URL parsing and redirs
Fix database update & query for http crawler