Refactored polyorcmatcher and spider

* Switched a couple of malloc to calloc.
* Refactored fix_url to be smarter, smaller and leaner.
* Removed find_prefix because it became obsolete after fix_url refactor.
* Added CURLOPT_FOLLOWLOCATION so spider follows redirects.
* Removed find_prefix related code in spider.
* Removed find_prefix related code in test.
Added new args to polyorc

* Copied them from the spider