rapid7/metasploit-framework — pull request #3541 by todb-r7 (2014-07-17 15:23:11+00:00)
Title: Include Hpricot for crawler modules (Was #3533)

Since we are not actually including Hpricot, we have several failing components:

````
$ grep -ril hpricot data
data/exploits/capture/http/forms/extractforms.rb
data/exploits/capture/http/forms/grabforms.rb
data/msfcrawler/basic.rb
data/msfcrawler/frames.rb
data/msfcrawler/forms.rb
data/msfcrawler/link.rb
data/msfcrawler/image.rb
data/msfcrawler/objects.rb
data/msfcrawler/scripts.rb
````

Note that the failing components all live in `data`, not `modules`, thus the confusion. The msfcrawler module is quite old and hasn't got a lot of maintenance in the last couple years, but it should at least not crash on the require.

The alternative to this fix is to remove the nonworking msfcrawler module, since it can't have worked for at least a year.