crawler code moved to crawler basic