Cognition of musical and visual accent structure alignment in film and animation

203 Pages·2002·1.44 MB·English

by  Scott D. Lipscomb

UNIVERSITY OF CALIFORNIA
Los Angeles

Cognition of musical and visual accent structure alignment
in film and animation

A doctoral dissertation submitted in partial satisfaction of the requirements
for the degree Doctor of Philosophy in Music

by
Scott David Lipscomb

1995
© Copyright by
Scott David Lipscomb
1995
ii
The dissertation of Scott David Lipscomb is approved.

__________________________________________
Roger Bourland

__________________________________________
Edward C. Carterette

__________________________________________
William Hutchinson

__________________________________________
James Thomas

__________________________________________
Roger A. Kendall, Committee Chair

University of California, Los Angeles
1995
ii
To my son, John David.
iii
TABLE OF CONTENTS
page #
LIST OF FIGURES x
LIST OF TABLES xiv
ACKNOWLEDGMENTS xvi
VITA xvii
ABSTRACT OF THE DISSERTATION xix
CHAPTER ONE—INTRODUCTION 1
Research Questions 2
Film Music Background 3
Purpose and Significance of the Study 6
Basic Assumptions 7
Delimitation 8
Hypotheses 9
CHAPTER TWO—RELATED LITERATURE 12
Proposed Model and Its Foundation 15
Musical and Visual Periodicity 17
The Communication of Musical Meaning 19
A 3-Dimensional Model of Film Classification 23
Accent Structure Alignment 26
Determinants of Accent 26
Sources of Musical Accent 29
Sources of Visual Accent 34
iv
A Common Language 38
Potential Sources of Musical and Visual Accent in the Present Study 39
Mapping of Audio-Visual Accent Structures 41
CHAPTER THREE—METHOD 42
Research Design 42
Subject Selection 43
Stimulus Materials 43
Experiment One 43
Experiment Two 45
Experiment Three 47
Exploratory Studies 47
Main Experiments 48
Alternative Hypotheses 51
Brief Summation 51
CHAPTER FOUR—EXPERIMENT ONE 53
Exploratory Study 53
Stimulus Materials 54
Auditory 54
Visual 54
Equipment 57
Subject Procedure 57
Data Analysis 58
Results 59
v
Statistical Analysis 63
Stimulus Selection for Experiment One 64
Main Experiment 65
Subjects 65
Equipment 66
Stimulus Materials 67
Stratification of Accent Structures 67
Experimental Task 68
Group One 68
Group Two 69
Results 70
Group One Data Analysis and Interpretation 70
Collapsing Alignment Conditions Across AV Composites 75
Analysis and Interpretation of Data Collapsed Across Alignment Con- 78
ditions
Group Two 79
Data Analysis 79
Multidimensional Scaling 80
Cluster Analysis 80
Conclusions 82
CHAPTER FIVE—EXPERIMENT TWO 84
Exploratory Studies 84
Stimulus Selection 84
Establishing Accent Structure 85
vi
Alignment Conditions 88
Main Experiment 92
Research Design, Hypotheses, and Subjects 92
Equipment 92
Stimulus Materials 92
Experimental Tasks 93
Results 94
Group One Data Analysis and Interpretation 94
Group Two Data Analysis 97
Multidimensional Scaling 97
Cluster Analysis 99
Conclusions 100
A Reassessment 102
CHAPTER SIX—EXPERIMENT THREE 104
Exploratory Studies 104
Stimulus Selection 104
Establishing Accent Structure 106
Alignment Conditions 109
Main Experiment 111
Research Design, Hypotheses, Subjects, and Equipment 111
Experimental Tasks 112
Results 112
Group One Data Analysis and Interpretation 112
vii
Group Two Data Analysis 117
Multidimensional Scaling 118
Cluster Analysis 120
Conclusions 121
Confirmation of Perceived Difference Between Consonant and Out-of- 122
Phase Composites
Interpretation of Data Analysis Across All Three Experiments 124
VAME Ratings 124
Synchronization 125
Effectiveness 127
Similarity Ratings 129
CHAPTER SEVEN—DISCUSSION, SUMMARY, AND CONCLUSIONS 132
Discussion 132
Limitations 139
Summary 141
Experiment One 144
Exploratory Studies 144
VAME Procedure 144
Similarity Judgment Procedure 146
Experiment Two 147
Exploratory Studies 147
VAME Procedures 148
Similarity Judgment Procedure 148
Experiment Three 149
viii
Exploratory Studies 149
VAME Procedure 150
Similarity Judgment Procedure 150
Data Analysis Across All Experiments 151
Synchronization 151
Effectiveness 153
Conclusions 153
Confirmation or Disconfirmation of Null Hypotheses 153
Research Questions Answered 156
Suggestions for Further Research 158
ENDNOTES 163
REFERENCES 169

ix