added Boilerpipe demo as source for web unflattering
added support for disabling crawler from crawler config