Measuring Arousal and Emotion in Healthcare Employees Using Novel Devices

Emma Fortune, Yaqoub Yusuf, Renaldo Blocker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A positive working environment is fundamental for reducing employee turnover, and increasing engagement and productivity. Technologies such as wearable sensors and video analysis of facial expressions can be used to objectively measure the emotional responses of employees in real-time in the workplace. The study aims were to perform a preliminary investigation into the validities of a wearable galvanic skin response (GSR) device to detect emotional arousal responses and video-based facial expression analysis (FEA) to measure emotional valence in desk-based healthcare employees in response to their own self-chosen personal pictures. Six office employees were presented with their own pictures (two positive, two negative) in a randomized order at one time point during their regular work shifts while wearing GSR sensors on the middle and index fingers of their non-dominant hand with their face in view of a webcam. The number of peaks per minute was estimated from the GSR data and used as the arousal metric. FEA was performed on the video data to determine the emotional valence for each stimulus. Russell's circumplex model of affect was used to determine participant's emotional responses to the personal pictures. The GSR device detected arousal responses to the stimuli, with agreement, precision, and recall values all \gt96%. Video-based FEA classified emotional valence with agreement, precision, and recall values \lt57%. Similarly, the circumplex model determined emotional affect with poor validity due to the poor validity of the FEA-derived valence metric. The study results suggest that the GSR device is capable of detecting emotional arousal for both positive and negative emotions in real-time in the workplace.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE 20th International Conference on Bioinformatics and Bioengineering, BIBE 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages835-838
Number of pages4
ISBN (Electronic)9781728195742
DOIs
StatePublished - Oct 2020
Event20th IEEE International Conference on Bioinformatics and Bioengineering, BIBE 2020 - Virtual, Cincinnati, United States
Duration: Oct 26 2020Oct 28 2020

Publication series

NameProceedings - IEEE 20th International Conference on Bioinformatics and Bioengineering, BIBE 2020

Conference

Conference20th IEEE International Conference on Bioinformatics and Bioengineering, BIBE 2020
Country/TerritoryUnited States
CityVirtual, Cincinnati
Period10/26/2010/28/20

Keywords

  • arousal
  • emotional affect
  • facial expression analysis
  • galvanic skin response
  • wearable sensors

ASJC Scopus subject areas

  • Biotechnology
  • Genetics
  • Molecular Biology
  • Artificial Intelligence
  • Computer Science Applications
  • Biomedical Engineering
  • Modeling and Simulation
  • Health Informatics

Fingerprint

Dive into the research topics of 'Measuring Arousal and Emotion in Healthcare Employees Using Novel Devices'. Together they form a unique fingerprint.

Cite this