A Multi-Session Evaluation of a Haptic Device in Normal and Critical Conditions: a Mars Analog Mission.

Julie Manon; Jean Vanderdonckt; Michael Saint Guillain; Vladimir Pletser; Cyril Wain; Jean Jacobs; Audrey Comein; Sirga Drouet; Julien Meert; Ignacio Sanchez Casla; Olivier Cartiaux; Olivier Cornu

doi:10.9781/ijimai.2025.04.001

Authors

Julie Manon Université Catholique de Louvain.
Jean Vanderdonckt Université Catholique de Louvain.
Michael Saint Guillain Université Catholique de Louvain.
Vladimir Pletser European Space Agency.
Cyril Wain Mission Analog Research Simulation (M.A.R.S. UCLouvain).
Jean Jacobs Mission Analog Research Simulation (M.A.R.S. UCLouvain).
Audrey Comein Mission Analog Research Simulation (M.A.R.S. UCLouvain).
Sirga Drouet Mission Analog Research Simulation (M.A.R.S. UCLouvain).
Julien Meert Mission Analog Research Simulation (M.A.R.S. UCLouvain).
Ignacio Sanchez Casla Mission Analog Research Simulation (M.A.R.S. UCLouvain).
Olivier Cartiaux ECAMBrussels Engineering School.
Olivier Cornu Université Catholique de Louvain.

DOI:

https://doi.org/10.9781/ijimai.2025.04.001

Keywords:

Context of Use, Haptic Device, Multi-Session, User Experience, UEQ+

Supporting Agencies

The authors would like to deeply thank the Mars Society, Dr. Shannon Rupert and the Mission Support staff to welcome the crew in the MDRS (Utah desert) for the opportunity to execute this research simulation in a Mars analogue environment. We also want to thank Dr. Kouamé Jean-Eric Kouassi for his PhD thesis about the creation of the new EZExFix, Pr. Benoît Lengelé and Pr. Catherine Behets for their day-to-day support in the realization of our multiple projects, and Lies Fievé and Christine de Ville de Goyet for their help to create artificial broken legs. This work was supported by a F.S.R. Fund («Fonds Spéciaux de Recherche», Belgium, Ref. ADi/16568.2021) and a «Student Angel Fund» (Ref. 304907648 val-31.05.), both granted by M.A.R.S. UCLouvain crew 2022, as well as a F.N.R.S. Aspirant Fund («Fonds National de la Recherche Scientifique», Belgium, Ref. ID 40004991) and a second F.S.R. Fund (Ref. ADi/IC/13936.2020), both granted by Dr. Julie Manon.

Abstract

While visual interaction is typically evaluated as an instantaneous, one-shot activity that considers only a snapshot of factors, haptic interaction is more challenging to evaluate as it involves a continuous touch process evolving over time. To better understand how to evaluate haptic interaction, this paper performs a multisession evaluation of a haptic device to be used by astronauts in future lunar and Mars missions, based on eight factors. Three groups of two members (???? = 6 ) applied, either as operator or assistant, a newly developed external fixator (EZExFix) to fix a fracture of the tibial shaft. Astronauts had different levels of expertise, i.e., in anatomy, mechanical engineering, and without, and participated in eight timed runs. Among these eight matches, four sessions were conducted with different time frames and compared to a stress test, a reproduction of the experiment in very stressful conditions, and a session simulating critical conditions in an extra-vehicular activity.

Downloads

Download data is not yet available.

References

S. Brewster, “Haptic human-computer interaction,” in Proceedings of the 4th Annual Conference of the ACM Special Interest Group on Computer-Human Interaction, CHINZ ’03, New York, NY, USA, 2003, p. 3–4, Association for Computing Machinery.

S. Villarreal-Narvaez, A. Sluÿters, J. Vanderdonckt, E. Mbaki Luzayisu, “Theoretically-defined vs. user- defined squeeze gestures,” Proceedings of the ACM on Human-Computer Interaction, vol. 6, pp. 73–102, nov 2022, doi: 10.1145/3567805.

V. Parthiban, P. Maes, Q. Sellier, A. Sluÿters, J. Vanderdonckt, “Gestural-vocal coordinated interaction on large displays,” in Companion Proceedings of the ACM Symposium on Engineering Interactive Computing Systems, EICS ’22 Companion, New York, NY, USA, 2022, p. 26–32, Association for Computing Machinery.

Y. Fang, Y. Qiao, F. Zeng, K. Zhang, T. Zhao, “A human-in-the-loop haptic interaction with subjective evaluation,” Frontiers in Virtual Reality, vol. 3, 2022, doi: https://doi.org/10.3389/frvir.2022.949324.

P. Xia, A. M. Lopes, M. T. Restivo, “Virtual reality and haptics for product assembly,” International Journal of Online and Biomedical Engineering, vol. 8, no. S1, pp. 12– 14, 2012, doi: 10.3991/ijoe.v8is1.1894.

M. Haruna, M. Ogino, T. Koike-Akino, “Proposal and evaluation of visual haptics for manipulation of remote machine system,” Frontiers in Robotics and AI, Section Smart Sensor Networks and Autonomy, vol. 7, 2020, doi: 10.3389/frobt.2020.529040.

J. Manon, C. Detrembleur, S. Van de Veyver, K. Tribak, O. Cornu, D. Putineanu, “Predictors of mechanical complications after intramedullary nailing of tibial fractures,” Orthopaedics Traumatology: Surgery Research, vol. 105, no. 3, pp. 523–527, 2019, doi: https://doi.org/10.1016/j.otsr.2019.01.015.

J. Manon, C. Detrembleur, S. Van De Veyver, K. Tribak, O. Cornu, D. Putineanu, “Can infection be predicted after intramedullary nailing of tibial shaft fractures?,” Acta Orthopædica Belgica, vol. 86, pp. 313–319, 2020.

J. Manon, C. Detrembleur, S. Van de Veyver, K. Tribak, O. Cornu, D. Putineanu, “Quels sont les facteurs prédictifs d'une complication mécanique après enclouage centromédullaire d'une fracture diaphysaire du tibia?,” Revue de Chirurgie Orthopédique et Traumatologique, vol. 105, no. 3, pp. 353–357, 2019, doi: 10.1016/j.rcot.2019.02.029.

K. J.-E. Kouassi, J. Manon, L. Fonkoue, C. Detrembleur, O. Cornu, “Treatment of open tibia fractures in sub- saharan african countries: a systematic review,” Acta Orthopaedica Belgica, vol. 87, no. 1, pp. 85–92, 2021, doi: 10.52628/87.1.11.

A. Terhorst, J. A. Dowling, “Terrestrial analogue research to support human performance on mars: A review and bibliographic analysis,” Space: Science & Technology, vol. 2022, 2022, doi: 10.34133/2022/9841785.

J. Vanderdonckt, R. Vatavu, J. Manon, M. Saint- Guillain, P. Lefèvre, J. J. Márquez, “Might as well be on mars: Insights on the extraterrestrial applicability of interaction design frameworks from earth,” in Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, CHI EA 2024, Honolulu, HI, USA, May 11-16, 2024, 2024, pp. 239:1–239:8, ACM.

C. Salisbury, R. Gillespie, H. Z. Tan, F. Barbagli, J. Salisbury, “What you can't feel won't hurt you: Evaluating haptic hardware using a haptic contrast sensitivity function,” IEEE Transactions on Haptics, vol. 4, pp. 134–146, apr 2011, doi: 10.1109/TOH.2011.5.

E. Samur, Performance Metrics for Haptic Interfaces. Springer Series on Touch and Haptic Systems, Springer, 2012.

A. Hamam, A. E. Saddik, “Toward a mathematical model for quality of experience evaluation of haptic applications,” IEEE Transactions on Instrumentation and Measurement, vol. 62, no. 12, pp. 3315–3322, 2013, doi: 10.1109/TIM.2013.2272859.

R. Höver, M. D. Luca, M. Harders, “User-based evaluation of data-driven haptic rendering,” ACM Transactions on Applied Perception, vol. 8, nov 2010, doi: 10.1145/1857893.1857900.

E. Samur, “Systematic evaluation methodology and performance metrics for haptic interfaces,” in Proceedings of the IEEE World Haptics Conference, WHC ’11, 2011, pp. 1–1.

A. Ahmad, K. Andersson, U. Sellgren, M. Boegli, “Evaluation of friction models for haptic devices,” in Proceedings of the Dynamic Systems and Control Conference, vol. 2 of Dynamic Systems and Control Conference, 10 2013, p. V002T26A005.

M. Saint-Guillain, J. Vanderdonckt, N. Burny, V. Pletser, T. Vaquero, S. Chien, A. Karl, J. Marquez, C. Wain, A. Comein, I. S. Casla, J. Jacobs, J. Meert, C. Chamart, S. Drouet, J. Manon, “Enabling astronaut self- scheduling using a robust advanced modelling and scheduling system: An assessment during a mars analogue mission,” Advances in Space Research, vol. 72, no. 4, pp. 1378–1398, 2023, doi: https://doi.org/10.1016/j.asr.2023.03.045.

J. Manon, V. Pletser, M. Saint-Guillain, J. Vanderdonckt, C. Wain, J. Jacobs, A. Comein, S. Drouet, J. Meert, I. J. Sanchez Casla, O. Cartiaux, O. Cornu, “An easy-to-use external fixator for all hostile environments, from space to war medicine: Is it meant for everyonersquo;s hands?,” Journal of Clinical Medicine, vol. 12, no. 14, 2023, doi: 10.3390/jcm12144764.

J. Manon, M. Saint-Guillain, V. Pletser, D. M. Buckland, L. Vico, W. Dobney, S. Baatout, C. Wain, J. Jacobs, A. Comein, S. Drouet, J. Meert, I. S. Casla, C. Chamart, J. Vanderdonckt, O. Cartiaux, O. Cornu, “Adequacy of in-mission training to treat tibial shaft fractures in mars analog testing,” Scientific Reports, vol. 13, 2023, doi: https://doi.org/10.1038/s41598-023-43878-1.

M. Schrepp, J. Thomaschewski, “Design and validation of a framework for the creation of user experience questionnaires,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 5, no. 7, pp. 88–95, 2019, doi: 10.9781/IJIMAI.2019.06.006.

B. Laugwitz, T. Held, M. Schrepp, “Construction and evaluation of a user experience questionnaire,” in Proceedings of the 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, HCI and Usability for Education and Work, USAB 2008, vol. 5298 of Lecture Notes in Computer Science, 2008, pp. 63–76, Springer.

A. Hinderks, M. Schrepp, M. Rauschenberger, J. Thomaschewski, “Reconstruction and validation of the UX factor trust for the user experience questionnaire plus (UEQ+),” in Proceedings of the 19th International Conference on Web Information Systems and Technologies, WEBIST 2023, 2023, pp. 319–329, SCITEPRESS.

B. Boos, H. Brau, “Erweiterung des UEQ um die dimensionen akustik und haptik,” in Proceedings of Usability Professionals, UP 2017, 2017, Gesellschaft für Informatik e.V. / German UPA e.V.

S. Shelat, J. A. Karasinski, E. E. Flynn-Evans, J. J. Marquez, “Evaluation of user experience of self- scheduling software for astronauts: Defining a satisfaction baseline,” in Engineering Psychology and Cognitive Ergonomics, Cham, 2022, pp. 433–445, Springer International Publishing.

E. Schön, J. Hellmers, J. Thomaschewski, “Usability evaluation methods for special interest internet information services,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 2, no. 6, pp. 26–32, 2014, doi: 10.9781/IJIMAI.2014.263.

M. Schrepp, A. Hinderks, J. Thomaschewski, “Construction of a benchmark for the user experience questionnaire (UEQ),” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 4, no. 4, pp. 40–44, 2017, doi: 10.9781/IJIMAI.2017.445.

L. J. Cronbach, “Coefficient alpha and the internal structure of tests,” Psychometrika, vol. 16, p. 297–334, 1951, doi: https://doi.org/10.1007/BF02310555.

S.-C. Liao, E. Hunt, W. Chen, “Comparison between inter-rater reliability and inter-rater agreement in performance assessment,” Annals of the Academy of Medicine, Singapore, vol. 39, pp. 613–8, 08 2010, doi: 10.47102/annals-acadmedsg.V39N8p613.

P. Legendre, “Species associations: the Kendall coefficient of concordance revisited,” Journal of Agricultural, Biological, and Environmental Statistics, vol. 10, no. 226, 2005, doi: https://doi.org/10.1198/108571105X46642.

A. Hinderks, M. Schrepp, F. J. D. Mayo, M. J. Escalona, J. Thomaschewski, “Developing a UX KPI based on the user experience questionnaire,” Computers Standards & Interfaces, vol. 65, pp. 38–44, 2019, doi: 10.1016/j.csi.2019.01.007.

A. Hinderks, A. -L. Meiners, F. Mayo, J. Thomaschewski, “Interpreting the results from the user experience questionnaire (ueq) using importance- performance analysis (ipa),” in Proceedings of the 15th International Conference on Web Information Systems and Technologies, WEBIST 2019, Setubal, PRT, 2019, p. 388–395, SCITEPRESS, Science and Technology Publications, Lda.

J. Cohen, Statistical power analysis for the behavioral sciences. New York, NY, USA: Routledge, 7 1988.

A. Schankin, M. Budde, T. Riedel, M. Beigl, “Psychometric properties of the user experience questionnaire (ueq),” in Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI ’22, New York, NY, USA, 2022, Association for Computing Machinery.

I. S. Saluja, D. R. Williams, D. Woodard, J. Kaczorowski, B. Douglas, P. J. Scarpa, J.- M. Comtois, “Survey of astronaut opinions on medical crewmembers for a mission to mars,” Acta Astronautica, vol. 63, no. 5, pp. 586–593, 2008, doi: https://doi.org/10.1016/j.actaastro.2008.05.002.

L. B. Landon, C. Rokholt, K. J. Slack, Y. Pecena, “Selecting astronauts for long-duration exploration missions: Considerations for team performance and functioning,” REACH, vol. 5, pp. 33–56, 2017, doi: https://doi.org/10.1016/j.reach.2017.03.002.