Emotional Arousal Detection

77 Pages·2014·2.64 MB·English

Emotional Arousal
Detection
Master’s Thesis
November2013
Student:Ing.H.J.Zuidhof
Primarysupervisor:Prof.Dr.Ir.M.Aiello
Secondarysupervisor:Dr.H.Riese

niversity of roningen
U G
motional rousal etection
E A D
Master’s thesis
Written for the
University of Groningen
Faculty of mathematics and natural science
and UMCG for the department of psychiatry
Supervised and coordinated by
Prof. Dr. Ir. M. Aiello (University of Groningen),
Dr. H. Riese (University Medical Center Groningen)
By
Ing. H.J. Zuidhof
11 1988
born the th of January
Groningen, The Netherlands
ABSTRACT
Duringthedayeveryoneexperiencesallkindsofemotions.Knowing
a person’s current emotion is very useful in medical and psychology
research. Detecting these emotions is not a trivial problem. Even the
human brain has trouble detecting emotional states. Technology can
help gaining more information about the emotional state of a human
subject.Astheemotionalstateofahumansubjectchangesanincrease
in heart rate can occur. Previous studies show that a combination of
heart rate and physical movement can be combined to form an index
for additional heart rate caused by emotional arousal. In this study,
anambulatoryreal-timesystemisdevelopedbasedontheadditional
heart rate index to detect emotional arousal of a human subject. The
system is evaluated by exposing ten female participants to emotional
stimuli.Subjectiveratingmethodsperformedonthedataacquiredby
theseexperimentsshowthatthemomentsofadditionalheartrateare
indeed caused by emotional arousal during laboratory experiments.
Ambulatory experiments show a less significant distinction between
additional heart rate and emotional arousal.
Keywords: Additional heart rate, emotional arousal, emotions
iv
ACKNOWLEDGMENTS
ThisreportistheresultofthemasterthesisprojectcarriedoutbyH.J.
Zuidhof at Department of Psychiatry University Medical Center of
Groningen (UMCG) and is the final product of the master Comput-
ing Science - Software Engineering & Distributed Systems at the Uni-
versity of Groningen (RUG). I thank all people from the UMCG who
helped me achieve this result. Especially I would like to thank Harri-
etteRieseforthecoordinationandmotivation.IwanttothankMarco
Aiello from the University of Groningen for the help and feedback
during the project. Without their help I would not have succeeded in
finishing this thesis.
v

CONTENTS
1 introduction 1
11 1
. Emotional arousal detection . . . . . . . . . . . . . . . .
12 2
. Research hypothesis . . . . . . . . . . . . . . . . . . . .
13 3
. Contribution . . . . . . . . . . . . . . . . . . . . . . . . .
2 background information and related work 5
21 5
. Background information . . . . . . . . . . . . . . . . . .
22 6
. Related work . . . . . . . . . . . . . . . . . . . . . . . . .
221 8
. . Heart rate analysis . . . . . . . . . . . . . . . . .
222 14
. . Feedback . . . . . . . . . . . . . . . . . . . . . . .
3 hardware 21
31 21
. Sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . .
32 23
. Architecture . . . . . . . . . . . . . . . . . . . . . . . . .
33 23
. Future hardware . . . . . . . . . . . . . . . . . . . . . .
34 24
. Discussion . . . . . . . . . . . . . . . . . . . . . . . . . .
4 development 27
41 27
. Algorithms . . . . . . . . . . . . . . . . . . . . . . . . . .
411 27
. . QRS complex . . . . . . . . . . . . . . . . . . . .
412 28
. . R top triggering . . . . . . . . . . . . . . . . . . .
413 28
. . Filtering . . . . . . . . . . . . . . . . . . . . . . .
414 29
. . Emotional arousal detection . . . . . . . . . . . .
42 32
. Software . . . . . . . . . . . . . . . . . . . . . . . . . . .
421 33
. . Class diagram . . . . . . . . . . . . . . . . . . . .
422 33
. . EmozionActivity . . . . . . . . . . . . . . . . . .
423 33
. . MeasurementService . . . . . . . . . . . . . . . .
424 33
. . Parcels . . . . . . . . . . . . . . . . . . . . . . . .
43 34
. Questionnaires. . . . . . . . . . . . . . . . . . . . . . . .
5 evaluation of a real time ambulatory system for
-
the detection of emotional arousal 37
51
. Validityofadditionalheartrateasanindicatorofemo-
38
tional arousal . . . . . . . . . . . . . . . . . . . . . . . .
52 39
. Laboratory and field study . . . . . . . . . . . . . . . .
53 39
. Aims of the present study . . . . . . . . . . . . . . . . .
54 40
. Methods . . . . . . . . . . . . . . . . . . . . . . . . . . .
541 40
. . Participants . . . . . . . . . . . . . . . . . . . . .
55 40
. Hardware . . . . . . . . . . . . . . . . . . . . . . . . . .
551 42
. . Questionnaires . . . . . . . . . . . . . . . . . . .
56 43
. Procedure . . . . . . . . . . . . . . . . . . . . . . . . . .
561 43
. . Intake. . . . . . . . . . . . . . . . . . . . . . . . .
562 44
. . Experiment . . . . . . . . . . . . . . . . . . . . .
563 44
. . Finish . . . . . . . . . . . . . . . . . . . . . . . . .
57 44
. Data assessment . . . . . . . . . . . . . . . . . . . . . . .
571 45
. . Subjective rating by testleader . . . . . . . . . .
vii
viii contents
572 45
. . Subjective rating by participants . . . . . . . . .
58 46
. Statistical analysis . . . . . . . . . . . . . . . . . . . . . .
581
. . DuringthelaboratoryexperimentsIexpecttrue
feedbacksatpredefinedemotionallyintensemo-
47
ments . . . . . . . . . . . . . . . . . . . . . . . . .
582
. . During the laboratory experiments low acceler-
ation and higher subjective affective scores and
heartratewillbefoundatthetruefeedbackmo-
47
ments compared to random feedback moments
583
. . During ambulatory assessment the differences
in heart rate, acceleration and subjective affec-
tive score between true and random feedback
47
moments are less/not distinguishable . . . . . .
59 47
. Results . . . . . . . . . . . . . . . . . . . . . . . . . . . .
591 47
. . Descriptives . . . . . . . . . . . . . . . . . . . . .
6 discussion and conclusion 55
61 55
. Discussion . . . . . . . . . . . . . . . . . . . . . . . . . .
62 56
. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . .
a emotional arousal algorithm myrtek and foer
( -
ster 2001 59
, )
b sensors 61
LIST OF FIGURES
1 9
Figure Heart system . . . . . . . . . . . . . . . . . . . .
2 12
Figure Heart rate variability . . . . . . . . . . . . . . .
3 14
Figure ANI . . . . . . . . . . . . . . . . . . . . . . . . .
4
Figure Example of an android implementation of a
15
slidebar . . . . . . . . . . . . . . . . . . . . . . .
5 16
Figure Simplified Geneva Emotion Wheel . . . . . . .
6 17
Figure Affect grid . . . . . . . . . . . . . . . . . . . . .
7 18
Figure Manikin . . . . . . . . . . . . . . . . . . . . . . .
8 23
Figure Visualization of the system. . . . . . . . . . . .
9 24
Figure Flexible hardware attached to the skin . . . . .
10 25
Figure System during use . . . . . . . . . . . . . . . .
11 27
Figure QRS Complex . . . . . . . . . . . . . . . . . . .
12 29
Figure Bandpass filtering . . . . . . . . . . . . . . . . .
13 29
Figure Disturbed ECG . . . . . . . . . . . . . . . . . .
14 1 31
Figure Killing . . . . . . . . . . . . . . . . . . . . . .
15 2 32
Figure Killing . . . . . . . . . . . . . . . . . . . . . .
16 34
Figure Class Diagram . . . . . . . . . . . . . . . . . . .
17 35
Figure Mood scale . . . . . . . . . . . . . . . . . . . . .
18
Figure Illustration of position of the BioHarness dur-
41
ing use . . . . . . . . . . . . . . . . . . . . . . .
19 43
Figure Affect grid . . . . . . . . . . . . . . . . . . . . .
20 45
Figure Trainspotting intensity . . . . . . . . . . . . . .
21 46
Figure Questionnaire mood . . . . . . . . . . . . . . .
22 52
Figure Trainspotting emotion intensity . . . . . . . . .
LIST OF TABLES
1 7
Table Physiological symptoms and motor expressions
2 22
Table Sensor Summary . . . . . . . . . . . . . . . . .
3
Table Information regarding the participants of the
41
experiment . . . . . . . . . . . . . . . . . . . . .
4 42
Table Specifications of the HTC One S. . . . . . . . .
5 300 42
Table Specification of the Huawei Ascend Y . . .
6 49
Table participant data . . . . . . . . . . . . . . . . . .
7 53
Table Feedback data . . . . . . . . . . . . . . . . . . .
ix