Abstract-Automated app review analysis is an important avenue for extracting a variety of requirements-related information. Typically, a first step toward performing such analysis is preparing a training dataset, where developers (experts) identify a set of reviews and, manually, annotate them according to a given task. Having sufficiently large training data is important for both achieving a high prediction accuracy and avoiding overfitting. Given millions of reviews, preparing a training set is laborious. We propose to incorporate active learning, a machine learning paradigm, in order to reduce the human effort involved in app review analysis. Our app review classification framework exploits three active learning strategies based on uncertainty sampling. We apply these strategies to an existing dataset of 4,400 app reviews for classifying app reviews as features, bugs, rating, and user experience. We find that active learning, compared to a training dataset chosen randomly, yields a significantly higher prediction accuracy under multiple scenarios.
Dhinakaran et al. REF perform app review classification and enhance existing approaches with active learning to reduce the annotation effort for experts.
App Review Analysis Via Active Learning: Reducing Supervision Effort without Compromising Classification Accuracy
2018 IEEE 26th International Requirements Engineering Conference (RE)
2018 IEEE 26th International Requirements Engineering Conference (RE)
Computer Science