Attention-based neural networks have demonstrated success in various NLP tasks, including disease prediction and emotion detection. They have been applied in combination with CNN and RNN, showing promise in achieving better results in sentiment analysis.