Local and global model interpretability via backward selection and clustering
LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks