Reference
Hibbeln, M., Jenkins, J. L., Schneider, C., Valacich, J. S., & Weinmann, M. (2017). How Is Your User Feeling? Inferring Emotion Through Human-Computer Interaction Devices. MIS Quarterly, 41(1), 1-21. (ABDC_2022: A*; ABS_2021: 4*; VHB_3: A+; FT_50_2016: yes)
Publication type
Article in Scientific Journal
Abstract
Experiencing negative emotion during system use can adversely influence important user behaviors, including purchasing decisions, technology use, and customer loyalty. Assessing negative emotion, however, can be challenging, especially in live Internet settings. We utilize attentional control theory to explain how mouse cursor movements can be a real-time indicator of negative emotion. We report three studies. In Study 1, an experiment with 65 participants from Amazon’s Mechanical Turk, we randomly manipulated negative emotion and then monitored participants’ mouse cursor movements as they completed a number-ordering task. We found that negative emotion increases the distance and reduces the speed of mouse cursor movements during the task. In Study 2, an experiment with 126 participants from a U.S. university, we randomly manipulated negative emotion and then monitored participants’ mouse cursor movements while shopping on a mock e-commerce site. We found that mouse cursor distance and speed can be used to infer the presence of negative emotion with an overall accuracy rate of 81.7%. In Study 3, an observational study with 80 participants from universities in Germany and Hong Kong, we monitored mouse cursor movements while participants interacted with an online product configurator. Participants reported their level of emotion after each step in the configuration process. We found that mouse cursor distance and speed can be used to infer the level of negative emotion with an out-of-sample R2 of 0.17. The results enable researchers to assess negative emotional reactions during live system use, examine emotional reactions with more temporal precision, conduct multi-method emotion research, and create more unobtrusive affective and adaptive systems.
Persons
Organizational Units
- Institute of Information Systems
- Hilti Chair of Business Process Management