Signed-off-by: urban48 <segrog@gmail.com>
new depth feature, now you can set the depth
the crawler can go, with the parameter "l"
defult is 1 if param not give,

depth 1 means scan the links and images
from the root url.

todo:
set depth 0 as infinite depth
little fixes
small fixes
few spelling fixes in comments
added the support in infinite depth crawling
also if depth parameter not given the crawler will only
retrive the data from the root url