 Neural networks have successfully advanced in the task of information extraction from structured documents . In business document processing more precise techniques equal more automation and less manual work. In this paper we will design and examine various fully trainable approaches to use siamese networks, concepts of similarity, one-shot learning and context/memory awareness. The aim is to improve micro F_{1 of per-word classification on a testing split of an existing real world document dataset. The results verify the hypothesis , that access to a similar (yet still different) page with it's target information improves the information extraction. Furthermore the added contributions (in addition to siamese networks) of employing a class information, query-answer attention module and skip connections to the similar page are all required to beat the previous results. Our best model improves previous state-of-art results by 0.0825 gain in F1 score. All the techniques used are not problem-specific and should be generalizable to help in other tasks and contexts . The code and anonymized version of the dataset are provided .
The automation of document processing is gaining recent attention due to the great potential to reduce manual work through improved methods and hardware. Neural networks have been successfully applied before - even though they have been trained only on relatively small datasets with hundreds of documents so far. To successfully explore deep learning techniques and improve the information extraction results, a dataset with more than twenty-five thousand documents has been compiled, anonymized and is published as a part of this work. We will expand our previous work where we proved that convolutions, graph convolutions and self-attention can work together and exploit all the information present in a structured document. Taking the fully trainable method one step further, we will now design and examine various approaches to using siamese networks, concepts of similarity, one-shot learning and context/memory awareness. The aim is to improve micro F1 of per-word classification on the huge real-world document dataset. The results verify the hypothesis that trainable access to a similar (yet still different) page together with its already known target information improves the information extraction. Furthermore , the experiments confirm that all proposed architecture parts are all required to beat the previous results. The best model improves the previous state-of-the-art results by an 8.25 gain in F1 score. Qualitative analysis is provided to verify that the new model performs better for all target classes. Additionally, multiple structural observations about the causes of the underperformance of some architectures are revealed. All the source codes, parameters and implementation details are published together with the dataset in the hope to push the research boundaries since all the techniques used in this work are not problem-specific and can be generalized for other tasks and contexts .
A
The automation of document processing is gaining recent attention due to the great potential to reduce manual work through improved methods and hardware.
R
successfully advanced in the task of information extraction from structured documents . In business document processing more precise techniques equal more automation and less manual work. In this paper we will
been successfully applied before - even though they have been trained only on relatively small datasets with hundreds of documents so far. To successfully explore deep learning techniques and improve the information extraction results, a dataset with more than twenty-five thousand documents has been compiled, anonymized and is published as a part of this work. We will expand our previous work where we proved that convolutions, graph convolutions and self-attention can work together and exploit all the information present in a structured document. Taking the fully trainable method one step further, we will now
R
fully trainable approaches to use
approaches to using
R
F_{1
F1
R
a testing split of an existing real world
the huge real-world
R
, that
that trainable
R
with it's
together with its already known
R
the added contributions (in addition to siamese networks) of employing a class information, query-answer attention module and skip connections to the similar page
, the experiments confirm that all proposed architecture parts
R
Our
The
R
previous state-of-art results by 0.0825
the previous state-of-the-art results by an 8.25
R
All the techniques used
Qualitative analysis is provided to verify that the new model performs better for all target classes. Additionally, multiple structural observations about the causes of the underperformance of some architectures are revealed. All the source codes, parameters and implementation details are published together with the dataset in the hope to push the research boundaries since all the techniques used in this work
R
should be generalizable to help in
can be generalized for
D
. The code and anonymized version of the dataset are provided