Implements #1162
Implements #1179

Conflicts:
	src/main/java/com/jaeksoft/searchlib/webservice/crawler/webcrawler/WebCrawlerImpl.java
Implements #1179
Merge pull request #1181 from emmanuel-keller/1.6

Improvements