tidy
fixed a bug when redirected with starting uri
improved example
added max_retry attribute
tiny fix on example
die
desides the extension by mime type
updated Crawler API usage to v0.04