Hierarchical multi-label text classification (HMTC) problems become popular recently because of its practicality. Most existing algorithms for HMTC focus on the design of classifiers, and are largely referred to as local, global, or a combination of local/global approaches . However, a few studies have started exploring hierarchical feature extraction based on the label hierarchy associating with textin HMTC . In this paper, aN eural network-based method calledLA-HCN is proposed where a novel\textbf{L abel-based\textbf{A ttention module is designed to hierarchically extract important information from the text based on different labels . Besides,  local and global document embeddings are separately generated to support the respective local and global classifications. In our experiments, LA-HCN achieves the top performance on the four public HMTC datasets when compared with other neural network-based state-of-the-art algorithms. The comparison between LA-HCN with its variants also demonstrates the effectiveness of the proposed label-based attention module as well as the use of the combination of local and global  classifications. By visualizing the learned attention (words), we find  LA-HCN is able to extract meaningful but different information from text based on different labels which is helpful for human understanding and explanation of classification results .
Hierarchical multi-label text classification (HMTC) has been gaining popularity in recent years thanks to its applicability to a plethora of real-world applications. The existing HMTC algorithms largely focus on the design of classifiers, such as the local, global, or a combination of them . However, very few studies have focused on hierarchical feature extraction and explore the association between the hierarchical labels and the text . In this paper, \textbf{ \textbf{ we propose a Label-based Attention for Hierarchical Mutlti-label Text Classification Neural Network (LA-HCN), where the novel label-based attention module is designed to hierarchically extract important information from the text based on the labels from different hierarchy levels . Besides, hierarchical information is shared across levels while preserving the hierarchical label-based information. Separate local and global document embeddings are obtained and used to facilitate the respective local and global classifications. In our experiments, LA-HCN outperforms other state-of-the-art neural network-based HMTC algorithms on four public HMTC datasets . The ablation study also demonstrates the effectiveness of the proposed label-based attention module as well as the novel local and global embeddings and classifications. By visualizing the learned attention (words), we find that LA-HCN is able to extract meaningful information corresponding to the different labels which provides explainability that may be helpful for the human analyst .
R
problems become popular recently because of its practicality. Most existing algorithms for HMTC
has been gaining popularity in recent years thanks to its applicability to a plethora of real-world applications. The existing HMTC algorithms largely
R
and are largely referred to as
such as the
R
local/global approaches
them
R
a
very
R
started exploring
focused on
R
based on the label hierarchy associating with textin HMTC
and explore the association between the hierarchical labels and the text
D
a
D
N
D
eural network-based method called
D
LA-HCN
D
is proposed where a novel
D
L
D
abel-based
D
A
R
ttention
we propose a Label-based Attention for Hierarchical Mutlti-label Text Classification Neural Network (LA-HCN), where the novel label-based attention
R
different labels
the labels from different hierarchy levels
A
hierarchical information is shared across levels while preserving the hierarchical label-based information. Separate
R
separately generated to support
obtained and used to facilitate
R
achieves the top performance on the
outperforms other state-of-the-art neural network-based HMTC algorithms on
R
when compared with other neural network-based state-of-the-art algorithms. The comparison between LA-HCN with its variants
. The ablation study
R
use of the combination of
novel
A
embeddings and
A
that
R
but different information from text based on
information corresponding to the
R
is helpful for human understanding and explanation of classification results
provides explainability that may be helpful for the human analyst