Add support to define allowed_domains inside the spider definition
Merge pull request #59 from andresp99999/generic-form-implementation

Add allowed_domains variable to spider definition
add script for easily run a slybot spider, and some README improvements
and adds
Show error details when failing to parse project json file
Merge pull request #71 from andresp99999/fix-error-message

Show error details when failing to parse project json file
avoid extra large line in tests
base url must be string in order to be urljoined with extracted url
use an alternate method for generating an IblItem class, in order to
have a base class (SlybotItem) for easy type checking.
added spiderlets code and docs
link extractors reorganization
fix import in doctest
add linkextractor module to setup
separate common code
renamed Plants to SampleProject
Merge pull request #72 from kalessin/master

Rename sample project 'Plants' to 'SampleProject'
get_base_url: fix case when base href is empty (use response url instead)
moved rss to xml, create xml link extractor and define rss link
extractor as subclass of xml one
added csv and regex link extractors, added tests for link extractors
allow html link extractor to accept also a html response as argument,
for api compatibility with rest of link extractors
csv reader does not accept parameters in unicode