First hack at set up reranker task.