added details of crawler features