A search engine evaluator provides feedback related to the accuracy and helpfulness of search results. The position is critical in helping engineers to adjust and improve algorithms to produce the best results. There are also some other variations of the job, like social media evaluation.