Classifying User Apps Review for Software Evolution: A Preliminary Experiment

Mutia Rahmi Dewi#, Hidayatul Munawaroh*, Siti Rochimah**
#Jurusan Teknologi Informasi, Politeknik Negeri Padang, Limau Manis, Padang, 25164, Indonesia
*Departemen Sistem Informasi, Universitas Internasional Semen Indonesia, Sidomoro, Gresik, 61122, Indonesia
**Departemen Informatika, Institut Teknologi Sepuluh Nopember, Keputih, Surabaya, 60111, Indonesia
E-mail: mutia@pnp.ac.id, hidayatu.munawaroh@uisi.ac.id, siti@if.its.ac.id

Abstract

Application Store is a platform where users can download several applications and games. Users also can provide comments about related applications. These comments made as evaluation material for developers, who have not yet developed applications in the future. In previous studies, an application user assessment has been carried out based on existing taxonomies such as feature requests, information provision, information retrieval, and problem discovery by using Natural Language Processing (NLP), Text Analysis (TA) and Sentiment Analysis (SA). In this study, we propose a model using Topic Modelling (TM) and Minority Synthetic OverSampling Technique (SMOTE) to improve classification results. Making user reviews that previously ignored can be taken into consideration for developers in conducting software development. Topic modelling will generate list of topics that representing each review and SMOTE method can overcome the amount of imbalanced data on several tables. We also combine methods TA + NLP + SA, TA + NLP + SA + TM, and TA + NLP + SA + TM + SMOTE with J48 classifier. In this study, can be seen the combination of TA+NLP+SA+TM+SMOTE+J48 method gives the highest result with 84.9% precision, 84.3% recall, and 84.6% F-Measure

Keywords— Natural Language Processing; Sentiment Analysis; Text Analysis; Topic Modelling User Apps Review.

Full Paper: Download Full Paper

Plagiarism Check: Download Check Plagiarism

Peer Review: Download Peer Review