Before revision:  We are the first to thoroughly investigate this powerful combination in sequence tagging . We find that taggers based on deep pre-trained models can benefit from Bayesian query strategies with the help of the Monte Carlo (MC) dropout.
After revision:  We are the first to thoroughly investigate this powerful combination for the sequence tagging task. We conduct an extensive empirical study of various Bayesian uncertainty estimation methods and Monte Carlo dropout options for deep pre-trained models can benefit from Bayesian query strategies with the help of the Monte Carlo (MC) dropout.