added docs about the crawler and its component.