On the Importance of UX Quality Aspects for Different Product Categories.

Martin Schrepp; Jessica Kollmorgen; Anna Lena Meiners; Andreas Hinderks; Dominique Winter; Harry B. Santoso; Jörg Thomaschewski

doi:10.9781/ijimai.2023.03.001

Authors

Martin Schrepp Heidelberg University
Jessica Kollmorgen University of Applied Sciences Emden Leer
Anna Lena Meiners University of Applied Sciences Emden Leer
Andreas Hinderks Universidad de Sevilla
Dominique Winter University of Siegen
Harry B. Santoso University of Indonesia
Jörg Thomaschewski University of Applied Sciences Emden Leer

DOI:

https://doi.org/10.9781/ijimai.2023.03.001

Keywords:

Questionnaire, UX, User Experience

Supporting Agencies

M. Schrepp, A. Hinderks, J. Thomaschewski, “Applying the User Experience Questionnaire (UEQ) in Different Evaluation Scenarios.” In: Marcus, A. (Ed.): Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience. Lecture Notes in Computer Science, Volume 8517, pp. 383-392, Springer International Publishing, 2014, DOI: 10.1007/978-3-319-07668-3_37.

Abstract

User experience (UX) is a holistic concept. We conceptualize UX as a set of semantically distinct quality aspects. These quality aspects relate subjectively perceived properties of the user interaction with a product to the psychological needs of users. Not all possible UX quality aspects are equally important for all products. The main use case of a product can determine the relative importance of UX aspects for the overall impression of the UX. In this paper, the authors present several studies that investigate this dependency between the product category and the importance of several well-known UX aspects. A method to measure the importance of such UX aspects is presented. In addition, the authors show that the observed importance ratings are stable, i.e., reproducible, and hardly influenced by demographic factors or cultural background. Thus, the ratings reported in our studies can be reused by UX professionals to find out which aspects of UX they should concentrate on in product design and evaluation.

Downloads

Download data is not yet available.

References

R. M. Ryan, “Psychological needs and the facilitation of integrative processes. Journal of personality”, 63(3), pp. 397-427, 1995.

K. M. Sheldon, A. J. Elliot, Y. Kim, T. Kasser, “What is satisfying about satisfying events? Testing 10 candidate psychological needs“, in Journal of personality and social psychology, 80(2), 325, 2001.

C. Lallemand, V. Koenig, G. Gronier, “How relevant is an expert evaluation of user experience based on a psychological needs-driven approach?“, in Proceedings of the 8th Nordic conference on human-computer interaction: Fun, fast, foundational (pp. 11-20), 2014.

M. Schrepp, User Experience Questionnaires: How to use questionnaires to measure the user experience of your products?, Kindle Direct Publishing, 2021, ISBN-13: 979-8736459766.

A. Hinderks, F. J. Domínguez-Mayo, A.-L. Meiners, J. Thomaschewski, “Applying Importance-Performance Analysis (IPA) to Interpret the Results of the User Experience Questionnaire (UEQ)“, in Journal of Web Engineering, 19(2), pp. 243-266, 2020.

D. Winter, A. Hinderks, M. Schrepp, J. Thomaschewski, “Welche UX Faktoren sind für mein Produkt wichtig?“, In: Hess, S. & Fischer, H. (Hrsg.), Mensch und Computer 2017 - Usability Professionals. Regensburg: Gesellschaft für Informatik e.V., pp. 191–200, 2017.

D. Winter, M. Schrepp, J. Thomaschewski, “Faktoren der User Experience - Systematische Übersicht über produktrelevante UX-Qualitätsaspekte“, In: Endmann, A.; Fischer, H. & Krökel, M. (Eds.), Mensch und Computer 2015 – Usability Professionals, pp. 33-41, DE GRUYTER, 2015,DOI: 10.1515/9783110443882-005.

A.-L. Meiners, J. Kollmorgen, M. Schrepp, and J. Thomaschewski, “Which UX aspects are important for a software product? Importance ratings of UX aspects for software products for measurement with the UEQ+”, in Proceedings of Mensch und Computer 2021 (MuC ‘21), Association for Computing Machinery, New York, NY, USA, 2021, pp. 136–139.

J. Kollmorgen, A.-L. Meiners, M. Schrepp, and J. Thomaschewski, „Ermittlung relevanter UX-Faktoren je Produktkategorie für den UEQ+“, in Mensch und Computer 2021 Workshopband, Association for Computing Machinery, New York, NY, USA, 2021.

M. Schrepp, J. Thomaschewski, “Design and Validation of a Framework for the Creation of User Experience Questionnaires”, in International Journal of Interactive Multimedia and Artificial Intelligence, 5(7), 2019, DOI: 10.9781/ijimai.2019.06.006

M. Schrepp, J. Thomaschewski, “Handbook for the modular extension of the User Experience Questionnaire. - All you need to know to apply the UEQ+ to create your own UX questionnaire”, 2019, DOI: 10.13140/RG.2.2.15485.20966.

DIN EN ISO 9241-110: Ergonomic requirements for office work with visual display terminals (VDTs) - Part 110: Guidance on usability. International Organization for Standardization.

DIN EN ISO 9241-210: Ergonomics of human-system interaction - Part 210: Human-centred design for interactive systems. International Organization for Standardization.

V. Roto, E. Law, A. Vermeeren, and J. Hoonhout, (Eds), “User Experience White Paper. Outcome of the Dagstuhl Seminar on Demarcating User Experience”, Germany, 2011. Accessed: Sep. 09, 2022. https://drops.dagstuhl.de/opus/volltexte/2011/2949/pdf/10373_AbstractsCollection.2949.pdf

J. R. Lewis, “Usability testing.” in Handbook of human factors and ergonomics, 12, e30, 2006.

B. E. John, D. E. Kieras, “The GOMS family of user interface analysis techniques: Comparison and contrast”, in ACM Transactions on ComputerHuman Interaction (TOCHI), 3(4), pp. 320-351, 1996.

K. Battarbee, and I. Koskinen, “Co-Experience: Product experience as social interaction”, in Product Experience, H. N. J. Schifferstein, and P. Hekkert, Eds., Amsterdam, Elsevier, 2008, pp. 461-476.

J. Preece, Y. Rogers, H. Sharpe, Interaction design: Beyond humancomputer interaction, Wiley, New York, 2002.

M. Hassenzahl, “The effect of perceived hedonic quality on product appealingness”, in International Journal of Human-Computer Interaction, 13(4), pp. 481-499, 2001.

M. Schrepp, R. Otten, K. Blum, and J. Thomaschewski, “What Causes the Dependency between Perceived Aesthetics and Perceived Usability?”, International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, no. 6, pp. 78-85, 2021, doi: 10.9781/ijimai.2020.12.005.

A. Klein, A. Hinderks, M. Schrepp, J. Thomaschewski, “Construction of UEQ+ Scales for Voice Quality - Measuring User Experience Quality of Voice Interaction”, In: Proceedings of the Conference on Mensch und Computer (MuC ‘20). Association for Computing Machinery, New York, NY, USA, pp. 1–5, 2020, DOI: https://doi.org/10.1145/3404983.3410003

J. Kollmorgen, A.-L. Meiners, M. Schrepp, J. Thomaschewski, “Protokoll zur Ermittlung relevanter UX-Faktoren je Produktkategorie für den UEQ+“, 2021, DOI: 10.13140/RG.2.2.16623.76960.

A.-L. Meiners, J. Kollmorgen, M. Schrepp, J. Thomaschewski, “Research Protocol: Ranking of important UEQ+ factors for established products“, 2021, DOI: 10.13140/RG.2.2.34986.95688.

E. Duncker, “Cross-cultural usability of the library metaphor”, In: Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries. ACM, pp. 223–230, 2002.

J. Noiwan, A. F. Norcio, “Cultural differences on attention and perceived usability: investigating color combinations of animated graphics”, in Int. J. Hum. Comput. Stud. 64 (2), pp. 103–122, 2006.

J. Nielsen, “Usability Engineering”, Elsevier, 1994.

A. Marcus, E. W. Gould, “Cultural dimensions and global web design: what? So What? Now what?”, In: Proceedings of the 6th Conference on Human Factors in the Web, Austin Texas, 2001.

R. Heimgärtner, Interkulturelles User Interface Design - Von der Idee zum erfolgreichen Produkt, Springer, Berlin Heidelberg, 2017.

D. Forer, G. Ford, “User performance and user interface design: usability heuristics versus cultural dimensions”, In: Proceedings of the South African Computer Lecturer’s Association 2003 Conference. Johannesburg, South Africa, 2003.

G. Hofstede, “Culture’s Consequences – Comparing Values, Behaviors, Institutions and Organizations across Nations”, 2. Edition, Thousand Oaks, London, Neu Delhi, 2001.

D. Straub, M. Keil, W. Brenner, “Testing the technology acceptance model across cultures: a three country study”, in Inf. Manag. 33 (1), pp. 1–11, 1997.

J. Nantel, E. Glaser, “The impact of language and culture on perceived website usability”, in J. Eng. Technol. Manag. 25 (1-2), pp. 112–122, 2008.

W. Fitzgerald, “Models for Cross-Cultural Communications for Cross-Cultural Website Design”, in National Research Council Canada, Institute for Information Technology, 2004.

N. B. Bryan, E. R. McLean, S. J. Smith, J. Burn, “The structure of work perceptions among Hong Kong and United States IS professionals: a multidimensional scaling test of the Hofstede cultural paradigm”, In: Duane, A., Finnegan, P. (Eds.), Proceedings of the 1994 Computer Personnel Research Conference on Reinventing IS: Managing Information Technology in Changing Organizations. ACM Press, New York, NY, USA, pp. 219–230, 1994.

M. Aparicio, F. Bacao, T. Oliveira, “Cultural impacts on e-learning systems’ success”, in Internet High Educ. 31, pp. 58–70, 2016.

J. C. Cronje, “Using Hofstede’s cultural dimensions to interpret crosscultural blended teaching and learning”, in Comput. Educ. 56, pp. 596–603, 2010.

A. Tarhini, K. Hone, X. Liu, “User acceptance towards web-based learning systems: investigating the role of social, organizational and individual factors in European higher education”, In: The 2013 International Conference on Information Technology and Quantitative Management. Elsevier, pp. 189–197, 2013.

F. Zhao, K. N. Shen, A. Collier, “Effects of national culture on e-government diffusion—a global study of 55 countries”, in Inf. Manag. 51, pp. 1005–1016, 2014.

D. H. Zhu, Z. Q. Ye, Y. P. Chang, “Understanding the textual content of online customer reviews in B2C websites: a cross-cultural comparison between the U.S. and China”, in Comput. Hum. Behav. 76, pp. 483–493, 2017.

H. B. Santoso, M. Schrepp, A. Hinderks, J. Thomaschewski, “Cultural differences in the perception of user experience“, in: Burghardt, M., Wimmer, R., Wolff, C., Womser-Hacker, C., Hrsg (Eds.), Mensch und Computer 2017 - Tagungsband. Gesellschaft für Informatik e.V., Regensburg, pp. 267–272, 2017.

F. Trompenars, “Riding the Waves of culture. Understanding Cultural Diversity in Business”, Brealey, London, 1995.

D. A. Victor, “International Business Communications”, Prentice Hall, New York, 1997.

E. T. Hall, “Beyond Culture”, Doubleday, New York, 1989.

A. Marcus, V. J. Baumgartner, “Mapping user-interface design components vs. culture dimensions in corporate websites”, Visible Lang. J. MIT Press 38 (1), pp. 1–65, 2004.

H. B. Santoso, M. Schrepp, “The impact of culture and product on the subjective importance of user experience aspects“, Heliyon, 5(9), e02434, 2019.