Integrating Heuristic Evaluation and Think-Aloud  Protocols By Applying Nielsen’s Metrics on Indonesian  e-Pangan Application

Rahma Fitria; Cut Meurah Nurul ‘Akla; Rini Meiyanti; Nova Kartika; Rifqa

doi:10.59934/jaiea.v3i3.508

Authors

Rahma Fitria Universitas Malikussaleh
Cut Meurah Nurul ‘Akla Universitas Malikussaleh
Rini Meiyanti Universitas Malikussaleh
Nova Kartika Universitas Malikussaleh
Rifqa Universitas Malikussaleh

DOI:

https://doi.org/10.59934/jaiea.v3i3.508

Keywords:

Usability Testing, Heuristic Evaluation, Think-aloud Protocols, Nielsen Metric, Mobile Evaluation

Abstract

Usability testing has emerged as one of the most important aspects of software testing to provide high-quality software to users. The purpose of this study is to evaluate the usability of an Indonesian mobile government application known as e-pangan. Because of the growing number of mobile phone users, the government has deployed mobile applications to make it easier for people to obtain information. Unfortunately, mobile government is not user-friendly and still has a lot of issues, as evidenced by user reviews in the Google Play store. The study employed a hybrid usability methodology that included heuristic evaluation and think-aloud protocols. The mobile government application Panel Harga Pangan will be tested to represent the study of this testing. Furthermore, the heuristic evaluation is performed by a usability expert, while the think-aloud protocols are performed by ten users. Nielsen's metrics are applied to measure the learnability, efficiency, memorability, error rate, and satisfaction of the application. The results of the research show that the application has an average score of 66%, indicating that while some users might discover it challenging others might discover it to be straightforward. This research is expected to be beneficial for usability practitioners or developers to develop a user-friendly e-government application.

Downloads

Download data is not yet available.

References

Hussain A and Fitria R 2018 Mobile flight and hotel booking application: a heuristic and UX Test Journal of Telecommunication, Electronic and Computer Engineering pp 93-101

Fitria R 2022 User experience test of frog virtual learning environment website Journal Informatika Kaputama (Medan) pp 26–47

Nielsen J 2012 Usability 101: introduction to usability (https://www.nngroup.com/articles/usability- 101-introduction-to-usability)

Alshammari T, Alhadreti O, and Mayhew, P J 2015 When to ask participants to think aloud: a comparative study of concurrent and restrospec-tive think-aloud methods International Journal of Human Computer Interaction (IJHCI)

Nielsen J 1994 Enhancing the explanatory power of usability heuristics Proc. of the SIGCHI Conference on Human Factors in Computing Sys-tems (CHI’94) pp 152-158

Fajarini P T, Wirdiani N K A and I.P. A. Dharmadi I P A 2020 Evaluasi portal berita online pada aspek usability menggunakan heurtistic evaluation dan think aloud Jurnal Teknologi Informasi Dan Ilmu Komputer

Larasati I 2020 evaluasi penggunaan website universitas islam negeri syarif hidayatullah jakarta dengan menggunakan metode usability testing Journal of Computer Science and Information Systems pp 68-77

Yumarlin M Z 2016 QUEST e-learning portal: applying heuristic evaluation, usability testing and eye tracking Universal Access in the Infor-mation Society pp 531–543

Chang, Chang C C and Johnson T 2021 Integrating heuristics and think-aloud approach to evaluate the usability of game-based learning material Journal of Computers in Education pp 137- 157

Paz F, Paz F A, Villanueva D, and Pow-Sang J A 2015 Heuristic evaluation as a complement to usability testing: a case study in WEB Domain Proc. 12th International Conference on Information Technology: New Generations (ITNG) pp 546–551

Nielsen J 2005 Usability engineering methods for software developers (ACM) pp 71-74

Kaikkonen A, Kekalainen A, Cankar M, Kallio T and Kankainen A 2005 Usability testing of mobile application: a comparison between labora-tory and field testing J. Usability Stud pp 4-16.

Nielsen J 2001 First Rule of Usability? Don’t Listen to Users (https://www.nngroup.com/articles/first-rule-of-usability-dont-listen-to-users/)

Gunduz F and Pathan A S K 2013 On the key factors of usability in small-sized mobile touch- screen application Int. J. Multimed. Ubiquitous Eng pp 115-138

Moller A, Roalter L, Diewald S, Scherr J, Kranz M, Hammerla N, Olivier P, and Plotz T 2012 GymSkill: a personal trainer for physical exer-cises, Int. Conf. Pervasive Comput. Commun. PerCom (IEEE) pp 213–220

Ayuni R and Ahsyar T K 2023 Evaluasi usability pada sistem informasi beasiswa menggunakan metode heuristic evaluation dan think aloud KLIK: Kajian Ilmiah Informatika dan Komputer vol 3 no 6 pp 737–745

Chang C C and Johnson T 2020 Integrating heuristics and think-aloud approach to evaluate the usability of game-based learning material Journal of Computers in Education vol 8 no 1 pp 137–157

Nielsen J 1990 World leaders in research-based user experience: 10 usability heuristics for user interface design (Nielsen Norman Group, https://www.nngroup.com/articles/ten-usability- heuristics/)

Nielsen J 1994 World leaders in research-based user experience: severity ratings for usability problems (Nielsen Norman Group, https://www.nngroup.com/articles/how-to- rate-the-severity- of-usability-problems)