Design Characteristics of Virtual Learning Environments: A Theoretical Integration and Empirical Test of Technology Acceptance and IS Success Research

242 Pages·2013·2.13 MB·English

by  Daniel Müller (auth.)

Design Characteristics
of Virtual Learning Environments
Daniel Müller
Design Characteristics
of Virtual Learning
Environments
A Theoretical Integration and Empirical
Test of Technology Acceptance
and IS Success Research
RESEARCH
Daniel Müller
Saarbrücken, Germany Bernhard Schmidt
Voestalpine Langenhagen, Deutschland
Linz, Österreich
Dissertation, Rechts- und Wirtschaftswissenschaftliche Fakultät der Universität des
Saarlandes, 2012
ISBN 978-3-658-00391-3 ISBN 978-3-658-00392-0 (eBook)
DOI 10.1007/978-3-658-00392-0
The Deutsche Nationalbibliothek lists this publication in the Deutsche Nationalbibliografie;
detailed bibliographic data are available in the Internet at http://dnb.d-nb.de.
Library of Congress Control Number: 2012950034
Springer Gabler
© Springer Fachmedien Wiesbaden 2013
This work is subject to copyright. All rights are reserved by the Publisher, whether the whole
or part of the material is concerned, specifically the rights of translation, reprinting, reuse of
illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical
way, and transmission or information storage and retrieval, electronic adaptation, computer
software, or by similar or dissimilar methodology now known or hereafter developed.
Exempted from this legal reservation are brief excerpts in connection with reviews or schol-
arly analysis or material supplied specifically for the purpose of being entered and executed
on a computer system, for exclusive use by the purchaser of the work. Duplication of this pub-
lication or parts thereof is permitted only under the provisions of the Copyright Law of the
Publisher’s location, in its current version, and permission for use must always be obtained
from Springer. Permissions for use may be obtained through RightsLink at the Copyright
Clearance Center. Violations are liable to prosecution under the respective Copyright Law.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this
publication does not imply, even in the absence of a specific statement, that such names are
exempt from the relevant protective laws and regulations and therefore free for general use.
While the advice and information in this book are believed to be true and accurate at the
date of publication, neither the authors nor the editors nor the publisher can accept any legal
r esponsibility for any errors or omissions that may be made. The publisher makes no warranty,
express or implied, with respect to the material contained herein.
Printed on acid-free paper
Springer Gabler is a brand of Springer DE. Springer DE is part of Springer Science+Business Media.
www.springer-gabler.de
Table of Contents
Table of Figures ....................................................................................................................... IX
Table of Tables ......................................................................................................................... XI
List of Abbreviations ............................................................................................................... XV
1 Introduction ........................................................................................................................ 1
2 A Research Framework of VLE Design Characteristics .................................................... 7
2.1 Dimensions ................................................................................................................. 7
2.1.1 Type of Success Measure Relevant To Stakeholder .............................................. 9
2.1.2 Type of Design Characteristic .............................................................................. 10
2.1.3 Type of Application Target .................................................................................. 10
2.1.4 Range of Validity ................................................................................................. 11
2.1.5 Method of Elicitation ........................................................................................... 13
2.1.6 Method of Evaluation ........................................................................................... 15
2.1.7 Level of Granularity ............................................................................................. 17
2.2 Transition to the Present Study and Derivation of the Research Design ................. 18
3 Theoretical Background and Outline of the Integrated Research Models ....................... 25
3.1 The Technology Acceptance Model and Design Characteristics ............................. 26
3.1.1 General Information ............................................................................................. 26
3.1.2 Transition to the Present Study ............................................................................ 33
3.2 The DeLone and McLean Information Systems Success Model and Design
Characteristics .......................................................................................................... 35
3.2.1 General Information ............................................................................................. 35
3.2.2 Transition to the Present Study ............................................................................ 38
3.3 Outline of the Integrated Research Models .............................................................. 39
4 Elicitation of VLE Design Characteristics ....................................................................... 45
4.1 Literature Review ..................................................................................................... 45
4.1.1 Method ................................................................................................................. 46
4.1.2 Results and Discussion ......................................................................................... 47
4.1.2.1 Overview ..................................................................................................... 47
4.1.2.2 Theoretical Foundation ............................................................................... 51
4.1.2.3 Range of Validity ........................................................................................ 52
4.1.2.4 Definition .................................................................................................... 53
4.1.2.5 Data Gathering Method ............................................................................... 54
4.1.2.6 Data Analysis Method ................................................................................. 55
4.1.2.7 VLE Design Characteristics ........................................................................ 55
4.2 Combined VLE Expert- and VLE User-Oriented Delphi Study .............................. 61
4.2.1 Method ................................................................................................................. 61
4.2.2 Results .................................................................................................................. 64
4.2.3 Discussion ............................................................................................................ 70
5 Evaluation of VLE Design Characteristics ...................................................................... 75
5.1 The Integrated Research Models and Hypotheses ................................................... 75
5.2 Method ..................................................................................................................... 78
5.2.1 Partial Least Squares as Data Analysis Method ................................................... 78
5.2.2 Research Instrument Construction ....................................................................... 80
5.2.2.1 Item Generation and Conceptual Validation ............................................... 81
5.2.2.2 Pilot Test ..................................................................................................... 83
5.2.3 Test for One-Dimensionality ................................................................................ 88
5.2.3.1 Measurement ............................................................................................... 89
5.2.3.2 Research Setting, Sample and Data Gathering Procedure .......................... 91
5.2.3.3 Results and Discussion................................................................................ 98

VI
5.2.4 Research Setting, Sample and Data Gathering Procedure of the Main
Field Survey ....................................................................................................... 108
5.3 Results .................................................................................................................... 111
5.3.1 Assessment of the Reflective Measurement Models .......................................... 111
5.3.1.1 Construct Reliability ................................................................................. 111
5.3.1.2 Indicator Reliability .................................................................................. 122
5.3.1.3 Construct Validity ..................................................................................... 129
5.3.2 Assessment of the Structural Models ................................................................. 144
5.3.2.1 Structural Model Version 1a ..................................................................... 146
5.3.2.2 Structural Model Version 2a ..................................................................... 148
5.3.2.3 Analysis of Unobserved Heterogeneity in the Structural Models
Version 1a and Version 2a/2aalt ................................................................ 152
5.3.3 Alternative Models ............................................................................................. 154
5.3.3.1 Measurement Models Version 1b and Version 2b .................................... 156
5.3.3.2 Structural Models ...................................................................................... 157
5.4 Discussion .............................................................................................................. 168
6 Conclusions .................................................................................................................... 185
6.1 Synopsis ................................................................................................................. 185
6.2 Implications ............................................................................................................ 187
6.2.1 Implications for Research ................................................................................... 187
6.2.2 Implications for Practice .................................................................................... 190
6.3 Limitations ............................................................................................................. 192
References .............................................................................................................................. 195
Appendices ............................................................................................................................. 219
1 Search Strings Applied to Elicit Relevant Literature on VLE Design
Characteristics ........................................................................................................ 219
VII
2 VLE Expert-Oriented Delphi Study to Elicit VLE Design Characteristics:
Participants Overview ............................................................................................ 220
3 VLE Expert- and VLE User-Oriented Delphi Study to Elicit VLE Design
Characteristics: Questionnaire – Phase I ................................................................ 221
4 VLE Expert- and VLE User-Oriented Delphi Study to Elicit VLE Design
Characteristics: Questionnaire – Phase II ............................................................... 223
5 Survey on Students’ Acceptance of Virtual Learning Environments ............................ 225

VIII
Table of Figures
Fig. 1. The Research Design of the Present Study. ............................................................. 21
Fig. 2. The TAM and Design Characteristics. ..................................................................... 29
Fig. 3. The TAM3: Behavioural Determinants of PU and PEOU. ...................................... 31
Fig. 4. The TAM3: Behavioural Determinants of PU and PEOU Relevant to the
Present Study. ........................................................................................................... 34
Fig. 5. The ISSM: Object-Based Beliefs, Object-Based Attitudes, and Success
Measures. .................................................................................................................. 36
Fig. 6. The ISSM: Object-Based Beliefs Relevant to the Present Study - Outline.............. 38
Fig. 7. The Integrated Research Model of Wixom & Todd (2005). .................................... 39
Fig. 8. The Integrated Research Models of the Present Study - Version 1a - Outline. ....... 40
Fig. 9. The Integrated Research Models of the Present Study - Version 2a - Outline. ....... 42
Fig. 10. Matching VLE Design Characteristics to VLE Functionalities – Conceptual
Outline. ..................................................................................................................... 43
Fig. 11. Object-Based Beliefs Relevant to the Present Study - Instantiation. ....................... 74
Fig. 12. The Integrated Research Models of this Study - Version 1a - Instantiation. ........... 75
Fig. 13. The Integrated Research Models of this Study - Version 2a - Instantiation. ........... 76
Fig. 14. Results of the Structural Analysis: Structural Model Version 2a. ......................... 148
Fig. 15. Results of the Structural Analysis: Structural Model Version 2b. ......................... 162
Fig. 16. Impact of Object-Based Beliefs on Behavioural Determinants of PU and
PEOU: Structural Model Version 1a - Summary. .................................................. 173
Fig. 17. Impact of Object-Based Beliefs on Object-Based Attitudes and Behavioural
Determinants of PU and PEOU: Structural Model Version 2a/2a -
alt
Summary. ............................................................................................................... 179
Fig. 18. Uncovering the Native Land/Real Affiliation of Object-Based Beliefs:
Structural Model Version 2b/2b - Summary. ...................................................... 181
alt
Table of Tables
Tab. 1. A Research Framework of VLE Design Characteristics. ........................................... 8
Tab. 2. Transferring the Research Framework of VLE Design Characteristics to the
Present Study. ........................................................................................................... 19
Tab. 3. The TAM3: Definitions and Sources of Behavioural Beliefs and Success
Measures. .................................................................................................................. 32
Tab. 4. The ISSM: Definitions and Sources of Object-Based Beliefs, Object-Based
Attitudes, and Success Measures. ............................................................................ 37
Tab. 5. The ISSM: Definitions and Sources of Object-Based Attitudes Relevant to the
Present Study. ........................................................................................................... 38
Tab. 6. Studies Concerning VLE Design Characteristics: Overview. .................................. 48
Tab. 7. VLE Design Characteristics: Theoretical Foundation. ............................................ 51
Tab. 8. VLE Design Characteristics: Range of Validity. ..................................................... 52
Tab. 9. VLE Design Characteristics: Definition. ................................................................. 53
Tab. 10. VLE Design Characteristics: Data Gathering Method. ............................................ 54
Tab. 11. VLE Design Characteristics: Data Source. .............................................................. 54
Tab. 12. VLE Design Characteristics: Data Analysis Method. .............................................. 55
Tab. 13. VLE Design Characteristics: Overview. .................................................................. 58
Tab. 14. Means and Standard Deviations of VLE Design Characteristics Ranks: VLE
Expert-Oriented Delphi Study. ................................................................................. 65
Tab. 15. Means and Standard Deviations of VLE Design Characteristics Ranks: VLE
User-Oriented Delphi Study. .................................................................................... 65
Tab. 16. Definitions, Sources, and Exemplary Statements of Object-Based Beliefs
Elicited. .................................................................................................................... 67
Tab. 17. Hypotheses. .............................................................................................................. 77
Tab. 18. Card-Sorting Approach: Item Placement Ratio - Results Overview. ....................... 83