Tests of Usability Guidelines About Response to User Actions. Importance, Compliance, and Application of the Guidelines.

Lucía Alonso Virgós; Jordán Pascual Espada; Gustavo Rossi

doi:10.9781/ijimai.2023.11.003

Authors

Lucía Alonso Virgós Universidad Internacional De La Rioja
Jordán Pascual Espada Universidad de Oviedo
Gustavo Rossi Universidad Nacional de La Plata

DOI:

https://doi.org/10.9781/ijimai.2023.11.003

Keywords:

Action, Guidelines, Recommendations, Usability, User Response, User Experience, Web

Abstract

Usability is a quality that a web page can have due to its simple use. Many recommendations aim to improve the web user experience, but there is no standardization of them. This study is part of a saga, which aims to order existing recommendations and guidelines by analyzing the behavior of 20 Information Technology (IT) developers. This publication analyzes the set of guidelines that determine "user responses" when they interact with a website. It is intended to group these guidelines and obtain data on the application of each of them. The test is carried out with 20 web developers without training or experience in web usability. The objective is to know if there are "user response" guidelines that a developer with no training or usability experience applies innate. Since web developers are also users, it is believed that there may be innate behavior that is not necessarily learned. The purposes of the work are: 1) Enumerate the most forgotten recommendations by web developers. This can help to think about the importance of offering specific training in this field. 2) Know the most important recommendations and guidelines, according to the web developers themselves. The investigation is carried out as follows: First, IT engineers were asked to develop a website; Second, user tests were performed and the most neglected and most applied guidelines were evaluated. The level of compliance was also analyzed, as developers lack experience in web usability and could be applying a guideline, but not correctly; Third, web developers are interviewed to find out what guidelines they consider necessary. The results are intended to help us understand if a web developer without training or experience in web usability can innately apply guidelines on "user responses". The objective of the study is to determine that there are guidelines that are applied intuitively and others that are not, and to know the reason for each situation. The results determine that the guidelines considered essential and those that are most applied innately have something in common. The results reveal that the essential guidelines and those that are most commonly implemented inherently share certain commonalities.

Downloads

Download data is not yet available.

References

R. González Crespo, J. Pascual Espada, and D. Burgos, “Social4all: Definition of specific adaptations in Web applications to improve accessibility,” Journal of Computers Standards and Interfaces, vol. 48, pp. 1-9, 2016.

E. Bader, E. M. Schön, and J. Thomaschewski, “Heuristics Considering UX and Quality Criteria for Heuristics,” International Journal of Interactive Multimedia & Artificial Intelligence, vol. 4, no. 6, pp. 48-53. 2017.

J. Nielsen, “10 usability heuristics for user interface design,” Nielsen Norman Group, 1995.

A. Lodhi, “Usability Heuristics as an assessment parameter: For performing Usability Testing”; in 2010 2nd International Conference Software Technology Engineering, vol. doi: 10.1109/ICSTE.2010.5608809, pp. V2-256-V2-259, 2010.

F. Paz, C. Villanueva, C. Rusu, S. Roncagliolo, and J. Pow-Sang, “Experimental Evaluation of Usability Heuristics,” in 2013 10th International Conference Information Technology New Generations, vol. doi: 10.1109/ITNG.2013.23, pp. 119–126, 2013.

C. Mariage, J. Vanderdonckt, and C. Pribeanu, “State of the Art” of Web Usability Guidelines, 2005, pp. 688–700.

L. Alonso-Virgós, et al., “Design specific user interface for people with Down syndrome using suitable WCAG 2.0 guidelines, “Journal of Ambient Intelligence and Humanized Computing, vol. 9, no. 5, pp. 1359-1374, 2018.

L. Alonso-Virgós, J. Pascual Espada, and R. González Crespo, “Analysing compliance and application of usability guidelines on efficient and understandable controls,” Computer Standards & Interfaces, vol. 66, p. 103349, 2019.

L. Alonso-Virgós, J. Pascual Espada, and R. González Crespo, “Analyzing compliance and application of usability guidelines and recommendations by web developers,” Computer Standards & Interfaces, vol. 64, pp. 117-132, 2019.

L. Alonso-Virgós, L. Rodríguez Baena, J. Pascual Espada, and R. González Crespo, “Web Page Design Recommendations for People with Down Syndrome Based on Users’ Experiences,” Sensors, vol. 18, no. 11, p. 4047, 2018.

H. Purchase, J. Allder, and D. Carrington, “User preference of graph layout aesthetics: A UML study,” International Symposium Graph Draw, no. 5–18, 2000.

D. Green and J. Pearson, “Integrating website usability with the electronic commerce acceptance model, “Behaviour & Information Technology, vol. 30 (2), pp. 181–199, 2011.

A. Hinderks, D. Winter, F. J. Domínguez Mayo, M. J. Escalona, and J. Thomaschewski, “UX Poker: Estimating the Influence of User Stories on User Experience in Early Stage of Agile Development,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 7, no. 7, pp. 97-104, 2022.

S. Majumder, S. Chowdhury, N. Dey, and K. C. Santosh, “Balance Your Work-Life: Personal Interactive Web-Interface, “International Journal of Interactive Multimedia and Artificial Intelligence, vol. 7, no. 7, pp. 90-96, 2022.

M. Bernard, “Examining user expectations for the location of common e-commerce web objects,” Usability News, vol. 4(1), pp. 1–7, 2002.

L. Alonso-Virgós and J. Thomaschewski, “Test usability guidelines and follow conventions. Useful recommendations from Web Developers,” Computer Standards & Interfaces, p. 103423, 2020.

M. Schrepp, R. Otten, K. Blum, and J. Thomaschewski, “What Causes the Dependency between Perceived Aesthetics and Perceived Usability?,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, issue Regular Issue, no. 6, pp. 78-85, 2021.

J. Nielsen, “Design Guidelines for Homepage Usability,” Nielsen Norman Group, 2001.

A. Baldominos, F. De Rada, and A. Sae, “DataCare: Big Data Analytics Solution for Intelligent Healthcare Management,” International Journal of Interactive Multimedia & Artificial Intelligence, vol. 4, no. 7, pp. 13-20, 2018.

J. Grobelny, W. Karwowski, and C. Drury, “Usability of Figure al icons in the design of human-computer interfaces,” International Journal of Human-Computer Interaction, vol. 18(2), pp. 167–182, 2005.

M. Rauschenberger, S. Olschner, M. Cota, M. Schrepp, and J. Thomaschewski, “Measurement of user experience: A Spanish language version of the user experience questionnaire (UEQ),” 7th Iberian Conference on Information Systems and Technologies (CISTI 2012). IEEE, 2012.

J. Nielsen and H. Loranger, “Prioritizing Web Usability,” New Riders Publishing, Thousand Oaks, CA, USA, 2006.

X. Wang, “Using Cognitive Walkthrough procedure to prototype and evaluate dynamic menu interfaces: A design improvement”, in 2008 12th International Conference Computer Supported Cooperative Work Des., pp. 76–80, 2008.

J. Duan, “Research on visualization techniques for web usability analysis”, in 2nd International Conference Information Science Engineering, pp. 5366–5369, 2010.

P. Filip and L. Lukáš, “Webalyt: Implemetation of architecture for capturing web user behaviours with feedback propagation,” 28th International Conference Radioelektronika (RADIOELEKTRONIKA). IEEE, 2018.

C. Li and C. Kit, “Web structure mining for usability analysis”, in 2005 IEEE/WIC/ACM International Conference Web Intell, pp. 309–312, 2005.

P. Kortum, “HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces”, San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 2008.

N. Mahyavanshi, M. Patil, and V. Kulkarni, “A realistic study of user behavior for refining web usability” in 2017 Int. Conf. I-SMAC (IoT Soc. Mobile, Anal. Cloud), pp. 450–453, 2017.

J. Schrepp and M. Hinderks, “Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S),” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 4, pp. 103–108, 2017.

K. Munim, I. Islam, M. Khatun, M. Karim, and M. Islam, “Towards developing a tool for UX evaluation using facial expression”, 3rd International Conference on Electrical Information and Communication Technology, pp. 1–6, 2017.

L. Martin, “A tool to estimate usability of Web 2.0 applications”, in 11th IEEE International Symposium on Web Systems Evolution, 2009,” pp. 83–86, 2009.

MM, “Usability Testing Case Study: Objective Evaluation vs Subjective Evaluation,” [Online]. Available: https://medium.com/@nurisanendita/usability-testing-case-studies-objective-evaluation-vs-subjectiveevaluation-b5e67d678e5e

C. Sik-Lányi, V. Szűcs, and T. Guzsvinecz, “Usability and colour-check of a healthcare WEB-site”, in 2017 IEEE 30th Neumann Colloquium, pp. 111–116, 2017.

J. Kirakowski and B. Cierlik, “Measuring the Usability of Web Sites,” Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 42, pp. 424–428, 1998.

T. Tullis, S. Fleischman, M. McNulty, C. Cianchette, and M. Bergel, “An Empirical Comparison of Lab and Remote Usability Testing of Web Sites,” in U.P.A. Conference (Ed.), Usability Professionals Association, 2002.

F. Paz, F. Paz, J. Pow-Sang, and L. Collantes, “Usability Heuristics for Transactional Web Sites,” in 2014 11th International Conference Information Technology New Generations, doi: 10.1109/ITNG.2014.81, 2014.

D. Quiñones, C. Rusu, and S. Roncagliolo, “Redefining usability heuristics for transactional web applications,” 2014 11th International Conference on Information Technology: New Generations. IEEE, 2014.

S. Papaloukas, K. Patriarcheas, and M. Xenos, “Usability Assessment Heuristics in New Genre Videogames” in 2009 13th Panhellenic Conference on Informatics, doi:10.1109/PCI.2009.14, pp. 202–206, 2009.

L, Gregory; S. Brent; Z. Nida, “Use of product viewing histories of users to identify related products.” U.S. Patent No 6,912,505, 28 Jun. 2005.

B. Dominic. “Predicting user response to advertisements.” U.S. Patent Application No 12/410,400, 8 Abr. 2010.

G. Salvador Cobos, M.D. Cima Cabal, F. Machío Regidor and L. Alonso Virgós. “Cyber-Physical System Architecture for Minimizing the Possibility of Producing Bad Products in a Manufacturing System” in Innovative Design and Operation of Digital Manufacturing EquipmentTrends and Prospect of Manufacturing Intelligence. Intech Open, 2019.

F. Eelke; B. Jan. “Architecturally sensitive usability patterns.” Department of Mathematics and Computing Science, University of Gronigen, Netherlands, 2003, pp. 1-19.

H. Zhao; B. Morad, “Usability and credibility of e-government websites.” Government Information Quarterly, 2014, vol. 31, no. 4, pp. 584-595.