Campaigns of Experimentation: Pathways to Innovation and Transformation (Information Age Transformation)

257 Pages·2005·1.48 MB·English

by  David S. Alberts

Information Age Transformation Series
CODE OF BEST PRACTICE
CAMPAIGNS
of
EXPERIMENTATION
Pathways to
Innovation and Transformation
David S. Alberts
Richard E. Hayes
Table of Contents
Acknowledgments.................................................................. xv
Preface .................................................................................. xix
Chapter 1: Introduction ..........................................................1
Purpose and nature of experimentation.....................................2
Transformation and experimentation........................................3
Nature of the campaigns required .............................................4
Exploring the tenets of NCW ..............................................5
Coevolution of mission capability packages.........................6
Coalition and interagency NCW .........................................8
Purpose and scope of this
Code of Best Practice (COBP) ...................................................8
Intended audience....................................................................11
Organization of the COBP......................................................12
Overview............................................................................12
Chapter by chapter ............................................................12
Chapter 2: Experimentation .................................................15
Sources of knowledge...............................................................15
Leaps: Great and small ............................................................16
Process of experimentation ......................................................18
Emergent v. managed experimentation...................................19
Experimentation risks and remedies ........................................21
Proceeding with insufficient evidence ................................21
Premature narrowing of focus............................................24
Confining explorations to the
Industrial-Information Age border ....................................26
Trial and error v. informed by theory ...............................27
vii
Failing to capitalize on
the creativity of the force....................................................28
Chapter 3: DoD Transformation ..........................................29
Why transform? .......................................................................29
Nature of DoD transformation ................................................30
Balancing the risks ...................................................................31
Informing DoD transformation ...............................................36
The role of experimentation
in transformation .....................................................................37
Chapter 4: Innovation in DoD Transformation ...................39
Nature of innovation................................................................41
A focus on disruptive innovation .............................................45
Tipping point ...........................................................................46
Experimentation and disruptive innovation ............................49
Creating a climate of innovation .............................................51
Climate of innovation ........................................................53
Processes of innovation and experimentation..............54
Recommendations .......................................................56
Chapter 5: Campaigns of Experimentation ..........................63
Nature of a campaign ..............................................................64
Anatomy of a campaign...........................................................69
Focus and objectives ..........................................................69
Conceptual model..............................................................70
Experiments .............................................................................72
Discovery experiments .......................................................73
Hypothesis testing experiments..........................................74
Demonstration experiments...............................................75
Analysis ..............................................................................76
Stages of a campaign................................................................77
viii
Formulating the campaign.................................................79
Investigation.......................................................................80
Education ...........................................................................82
Caveats...............................................................................82
Fidelity and control ............................................................83
Fidelity and control in discovery experiments .............84
Fidelity and control in modeling and simulation .........85
Fidelity and control in laboratory experiments............87
Fidelity and control in exercises...................................88
Pacing.................................................................................91
Experimentation infrastructure..........................................94
Chapter 6: Planning and Executing
Campaigns of Experimentation ..........................97
Understanding and organizing
campaigns of experimentation .................................................97
Establishing conditions for success...................................100
Building a strong team ...............................................100
Creating an explicit conceptual model ......................101
Conducting a sound campaign ........................................101
Peer reviews ...............................................................102
Documentation and keeping the
conceptual model up-to-date .....................................103
Analyses beyond individual experiments ...................106
Creating a foundation for the future................................108
Types of transformational campaigns....................................111
MCP maturity........................................................................114
Phases of a campaign .............................................................117
Formulation .....................................................................117
Concept definition ...........................................................118
Refinement.......................................................................120
ix
Demonstration .................................................................124
Guiding principles for campaigns of experimentation...........124
Chapter 7: Experimentation Campaigns:
State of the Practice...........................................127
Introduction ...........................................................................127
Typical campaign practices ...................................................130
Misadventures in campaigns of experimentation ..................135
Barriers to transformational
campaigns of experimentation ...............................................139
State of the practice summary ...............................................141
Chapter 8: Harvesting Results ............................................143
Campaign synergies ...............................................................144
Building a body of knowledge................................................150
Chapter 9: The Way Ahead................................................153
Better experiments .................................................................154
Establishing the prerequisites for success ...............................155
Campaigns of experimentation..............................................160
Challenges to organize
campaigns around..................................................................161
The challenge of mission diversity ...................................161
The challenge of agile organizations................................162
The challenge of achieving shared awareness .................163
The challenge of leveraging awareness ............................166
Illustrative campaigns ............................................................170
Command and control
in a networked environment ............................................171
Command and control
for stabilization operations...............................................174
x
Command arrangements
for homeland defense and homeland security .................177
Conclusion .............................................................................181
Appendix: Checklists ...........................................................183
The campaign checklist .........................................................184
The experimentation checklist ...............................................189
Contributors’ bios ..................................................................214
Bibliography ........................................................................217
About the Authors ...............................................................225
Catalog of CCRP Publications...................................... CAT-1
xi
List of Figures
Figure 1. Mission Capability Package Landscape...................7
Figure 2. Sustaining Innovation v. Disruptive Innovation....10
Figure 3. Temporal Dynamics of Innovation .......................48
Figure 4. Maturity of MCP/Theory ...................................116
Figure 5. C2 in a Networked Environment
Campaign Conceptual Model .............................173
Figure A. The Iterative Cycle for Experimentation............191
xiii