  Although open-domain question answering (QA) draws great attention in recent
years, it requires large amounts of resources for building the full system and
is often difficult to reproduce previous results due to complex configurations.
In this paper, we introduce SF-QA: simple and fair evaluation framework for
open-domain QA. SF-QA framework modularizes the pipeline open-domain QA system,
which makes the task itself easily accessible and reproducible to research
groups without enough computing resources. The proposed evaluation framework is
publicly available and anyone can contribute to the code and evaluations.
