added two classed SearchDocument
changed the main to crawler only at the beginning
changed the main to crawler only at the beginning