Before revision:  We show that the ensemble of contextualized language models provides an effective method to extract information from chemical patents. As a next step, we will investigate the effect of transformer language models pre-trained in chemical patents.
After revision:  We show that the ensemble of contextualized language models provides an effective method to extract information from chemical patents.