Assessing induced emotions in employees in a workplace setting using wearable devices

Emma Fortune, Yaqoub Yusuf, Sarah Zornes, Jorge Loyo Lopez, Renaldo Blocker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A working environment which elicits positive emotions in employees is vital for employee retention, engagement and productivity. Wearable sensors provide the means to objectively measure the emotional responses of employees in the workplace in real-time. The study aim was to perform a preliminary investigation into the validity of two multimodal systems to classify employee's emotional responses to positive, neutral or negative video stimuli: (1) using wearable electroencephalography (EEG) in combination with video-based facial expression analysis (FEA), and (2) using a wearable galvanic skin response (GSR) device in combination with video-based FEA. Five office employees each watched three short video clips at three time points during their regular work shifts while wearing EEG sensors on the forehead and GSR sensors on the middle and index fingers of their non-dominant hand with their face in view of a webcam. Russel's circumplex model of affect was used to determine participant's emotional responses to the video clips. The GSR device showed greater accuracy than the EEG device at detecting arousal responses to the video stimuli, with agreement, precision, and recall values of 87%, 100% and 80%, respectively, compared to 53%, 62%, and 80% for the EEG device. The FEA/EEG and FEA/GSR circumplex models were both able to accurately detect positive emotions elicited from video stimuli with levels of agreement and recall greater than 73%. Precision for the FEA/EEG model to detect positive stimuli was lower due to misclassification of 40% of both negative and neutral stimuli as positive. Precision values for both circumplex models were very low for detecting negative emotions. The results suggest that the EEG and GSR devices may be capable of detecting arousal when used alone, and detecting positive emotions when used in combination with video-based FEA in real-time in the workplace.

Original languageEnglish (US)
Title of host publicationFrontiers in Biomedical Devices, BIOMED - 2020 Design of Medical Devices Conference, DMD 2020
PublisherAmerican Society of Mechanical Engineers (ASME)
ISBN (Electronic)9780791883549
DOIs
StatePublished - 2020
Event2020 Design of Medical Devices Conference, DMD 2020 - Minneapolis, United States
Duration: Apr 6 2020Apr 9 2020

Publication series

NameFrontiers in Biomedical Devices, BIOMED - 2020 Design of Medical Devices Conference, DMD 2020

Conference

Conference2020 Design of Medical Devices Conference, DMD 2020
CountryUnited States
CityMinneapolis
Period4/6/204/9/20

Keywords

  • Electroencephalography
  • Emotional affect
  • Facial expression analysis
  • Galvanic skin response
  • Wearable sensors

ASJC Scopus subject areas

  • Biomedical Engineering

Fingerprint Dive into the research topics of 'Assessing induced emotions in employees in a workplace setting using wearable devices'. Together they form a unique fingerprint.

Cite this