initial commit. code taken from shub r2543
updated setup.py and README
removed some unneeded code in closespider extension, some variable name changes, and fixed ibl spider to work with last changes for supporting link areas extraction
Merge pull request #2 from kalessin/master

fixed ibl spider to work with last changes for supporting link areas extraction
use htmlregion text_content in number, price and text extractors. Fixed doc tests.
Merge pull request #3 from kalessin/master

use htmlregion text_content in number, price and text extractors
fix text extraction to avoid to match whitespace chars
Merge pull request #4 from kalessin/master

fix text extraction to avoid to match whitespace chars (previously wrongly done in adapt method, fixes last commit)
separate code that makes the url filter, and allow to specify not to follow links
Merge pull request #5 from kalessin/master

separate code that makes the url filter, and allow to specify not to follow links
simplified unnecesary complex and inefficient code
for safe html extractor, extracts only if region has no empty text content
Merge pull request #6 from kalessin/master

for safe html extractor, extract only if region has no empty html code. This prevents matching regions only containing markup
include id of template used in extraction as item metadata instead of return appart
Merge pull request #7 from kalessin/master

include id of template used in extraction as item metadata instead of return appart
Support link extraction from standard onclick inline js
Merge pull request #8 from kalessin/master

Support link extraction from standard onclick inline js
added new test case in link extractor ('a' tag with no href) and fixed
code for correct handling (previous version was raising exception with
this case)
Merge pull request #9 from kalessin/master

added new test case in link extractor and fix handling
added spider tests, fixed link extraction case when there is a link extraction template, simplified code in order to avoid to pass unnece
    sary parameter to _process_link_regions