DTIC ADA513889: System of Systems (SoS) M&S VV&A Decomposition: Integrated System Level VV&A (ISLA)

0.23 MB·English

by  Defense Technical Information Center

System of Systems (SoS) M&S
VV&A Decomposition:
Integrated System Level VV&A (ISLA)
Dr. Jeffrey S. Strickland
Certified Modeling & Simulation Professional
MDA M&S V&V Technical Director
Distribution Statement A:
Approved for public release; distribution is unlimited
Approved for Public Release 1
08-MDA-4059 (5 JAN 09)
Report Documentation Page Form Approved
OMB No. 0704-0188
Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and
maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information,
including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington
VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it

does not display a currently valid OMB control number.
1. REPORT DATE 3. DATES COVERED
JAN 2009 2. REPORT TYPE 00-00-2009 to 00-00-2009
4. TITLE AND SUBTITLE 5a. CONTRACT NUMBER
System of Systems (SoS) M&S VV&A Decomposition: Integrated System
5b. GRANT NUMBER
Level VV&A (ISLA)
5c. PROGRAM ELEMENT NUMBER
6. AUTHOR(S) 5d. PROJECT NUMBER
5e. TASK NUMBER
5f. WORK UNIT NUMBER
7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) 8. PERFORMING ORGANIZATION
Missile Defense Agency,7100 Defense REPORT NUMBER
Pentagon,Washington,DC,20301-7100
9. SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR’S ACRONYM(S)
11. SPONSOR/MONITOR’S REPORT
NUMBER(S)
12. DISTRIBUTION/AVAILABILITY STATEMENT
Approved for public release; distribution unlimited
13. SUPPLEMENTARY NOTES
Live-Virtual Constructive Conference, 12-15 Jan 2009, El Paso, TX
14. ABSTRACT

15. SUBJECT TERMS
16. SECURITY CLASSIFICATION OF: 17. LIMITATION OF 18. NUMBER 19a. NAME OF
ABSTRACT OF PAGES RESPONSIBLE PERSON
a. REPORT b. ABSTRACT c. THIS PAGE Same as 18
unclassified unclassified unclassified Report (SAR)
Standard Form 298 (Rev. 8-98)
Prescribed by ANSI Std Z39-18
Purpose
• The purpose of this brief to propose an
approach for performing “system of
system” level V&V of the BMDS
representations.
Approved for Public Release 2
08-MDA-4059 (5 JAN 09)
BMDS SoS Hierarchical View
System-Level (SoS) V&V Element-Level (System) V&V
• SoS Interfaces • Enterprise Rules • System Interfaces • Data model
• SoS Behavior • Scenarios • System Rules
• SoS Framework • Metadata model • System Framework
• Boundaries
SoS
(BMDS)
Enterprise Rules
Interfaces
System 1 System 2 System n
(GMD) (THAAD) (AN/TPY-2)
Interfaces Interfaces
Sub-System 1 Sub-System 2 Sub-System 3 Sub-System 1 Sub-System 2 Sub-System 3
System (GFC) (IFICS) M&S (GBI) (TFCC) (Radar) (Missile)
Elements
Sub-system
Elements
Component 1 Component 2 Component 1 Component 2
(XXXX) (XXXX) (XXXX) (XXXX)
“Environment”
Approved for Public Release 3
08-MDA-4059 (5 JAN 09)
BMDS SoS M&S Architecture Characteristics (U)
Permits use of specialized
Isolation mechanism for
hardware and software
proprietary code
Private
Networks
Provides access to
tactical messaging
Discrete Event
External
Models Models Provides low entry cost
Link-16 for legacy simulations
OMF EMF
Interoperates with VMF, etc.
hardware in the loop
Simulation Engine
Components
HWIL via
Gateways
Relies on proven
RE or TIU
Middleware
GOTS infrastructure
Components
DIS
Permits interoperation HLA Allows single source
with other simulations Database for threat representation
Provides for common semantics
Lifecycle
and correlation in support of analysis Applications Optimistic
Processing
Provides for common Offline
simulation management Accessible
Approved for Public Release 4
08-MDA-4059 (5 JAN 09)
BMDS SoS M&S VV&A Tool Metric Dendritic
MOE = Measure of Effectiveness AC = Acceptability Criteria
System
MOP = Measure of Performance
Requirements
TPM = Technical Performance Measure (some my be “critical”, CPM)
Documents
MOE 0
SoS AC 0.0
MOP 0.1 MOE 1
DE Sim
Enterprise Rules MOP 0.2 MOE 2
MOP 0.3
MOE n
AC 2.0
Interfaces
AC 1.0
MOP 1.1 MOP 2.1
System 1 M&S System 2 M&S System n M&S M&S
MOP 1.2 MOP 2.2
(GMD) (THAAD) MOP 2.3 (AN/TPY-2) Rqmts
MOP 1.3
Documents
Interfaces Interfaces MOP n.1
MOP n.2
Sub-System 1 Sub-System 2 Sub-System 3 Sub-System 1 Sub-System 2 Sub-System 3
M&S (GFC) M&S (IFICS) M&S (GBI) M&S (TFCC) M&S (Radar) M&S (Missile)
TPM n.1.1
TPM 1.3.1 TPM 1.1.1
TPM 1.1.1 Scenario
Documents
Component 1 Component 2 Component 1 Component 2
M&S (XXXX) M&S (XXXX) M&S(XXXX) M&S (XXXX)
M&S Architecture Framework
M&S “Environment”
Approved for Public Release 5
08-MDA-4059 (5 JAN 09)
BMDS SoS M&S VV&A Event Metric Dendritic
CAI = Critical Analysis Issue AC = Acceptability Criteria
Test
MOP = Measure of Performance Objectives
TPM = Technical Performance Measure (some my be “critical”, CPM) Documents
CAI 0
SoS
MOP 0.1 CAI 1
DE Sim
Enterprise Rules MOP 0.2 CAI 2
MOP 0.3
CAI n
Interfaces
MOP 1.1 MOP 2.1
System 1 MOP 1.2 System 2 MOP 2.2 System n M&S
(GMD) MOP 1.3 (THAAD) MOP 2.3 (AN/TPY-2) Rqmts
Documents
Interfaces Interfaces AC 0.0 MOP n.1
MOP n.2
Sub-System 1 Sub-System 2 Sub-System 3 Sub-System 1 Sub-System 2 Sub-System 3
(GFC) (IFICS) (GBI) (TFCC) (Radar) (Missile)
AC n.0
AC 1.0 TPTPMM 2 .13..11.1 TPTPMM n .11..11.1
Scenario
TPM 1.3.1
TPM 1.1.1 Documents
Component 1 Component 2 Component 1 Component 2
(XXXX) (XXXX) (XXXX) (XXXX)
M&S Architecture Framework
M&S “Environment”
Approved for Public Release 6
08-MDA-4059 (5 JAN 09)
Test Objective Relationship to Acceptability Criteria
Intended Use Test MOP 1.1 Acceptability Criteria I Metric/TPM I.1 Metric/TPM I.2 Metric/TPM I.3
Objective 1
• Performance (e.g. CAI 1)
Assessment MOP 1.2
• Ground Test
MOP 1.3 Acceptability Criteria II Metric/TPM II.1 Metric/TPM II.2 Metric/TPM II.3
• Flight Test
Support
• War Games
Test MOP 2.1 Acceptability Criteria III Metric/TPM III.1 Metric/TPM III.2 Metric/TPM III.3
• Exercises
Objective 2
• Element (CAI 2)
Integration MOP 2.2
• Internal Use
Acceptability Criteria IV Metric/TPM IV.1 Metric/TPM IV.2 Metric/TPM IV.3
• Concept
Development
• Planning Test MOP 3.1
Objective 3
(CAI 3)
MOP 3.2 Acceptability Criteria V Metric/TPM V.1 Metric/TPM V.2 Metric/TPM V.3
Test MOP N.1
Objective n
(CAI N)
MOP N.N Acceptability Criteria n Metric/TPM n.1 Metric/TPM n.2 Metric/TPM n.3
Test Objectives focus on the expected performance assessment of the
operational BMDS to be completed using data from the test event
Approved for Public Release 7
08-MDA-4059 (5 JAN 09)
Issues
• Which interfaces are “truly” SoS level
• How do we V&V interfaces?
• What in DSA corresponds to a
Federation Object Model (FOM) in
HLA?
• How do we achieve meta-model
validation in the absence of a
conceptual model?
• What constitutes a metadata model?
Approved for Public Release 8
08-MDA-4059 (5 JAN 09)
SoS M&S Verification & Validation Requirements
Event/Test Acceptability Accreditation
Objectives Criteria Plan
Integrated System
Level V&V
Element-Level VV&A System-Level
Analysis Planning Analysis Accreditation
AB VV&A BC VV&A Requirement Design Scenario Interfaces COMM
Verification
Interface Blue Force
GM VV&A JTAGS VV&A Verification Metamodel Configuration Information Flow Transmission
Analysis Analysis Analysis
Threats
SPAWAR Design
LTPO VV&A
VV&A Verification M&S Data Flow Architecture
Requirements Analysis Analysis
Threat
Implementation
SBIRS VV&A MDSE VV&A Build
Verification Test Intended Information Network
Uses Threat Exchange Analysis
Results Consistency
THAAD VV&A DE SIM VV&A Validation Metadata Gateways Function Flow
Analysis Environment Analysis
Conceptual Model
Validation Enterprise
Rules Element Model
Consistency
Environment
Accuracy
Framework Truth State Data Comparison Interface Validation
Approved for Public Release 9
08-MDA-4059 (5 JAN 09)