DTIC ADA504256: Fight's On! Newsletter. Volume 8, Issue 2, Summer 2009

1.2 MB·English

by  Defense Technical Information Center

Published by the Warfighter Readiness Research Division Volume 8, Issue II
711th Human Performance Wing / RHA of the Air Force Research Laboratory
Human Effectiveness Directorate SUMMER 2009
The Warfighter Readiness Assessment and Performance
Measurement Tracking System Goes Operational!
Imagine a flight of ment and integration is
two F-16 simulators and a catalyst for work now
two real F-16s flying underway with the Com-
over a gun range in the bined Air and Space
next state directed by Operations Center Per-
a joint tactical air con- formance Assessment
troller immersed in a System.
separate virtual reality
Integrating PETS into
environment nearby. The
operational commercial
common link is that they
training facilities such
all see and communicate
as the F-15 Mission
with each other in real
Training Center (MTC)
time, and share a train-
at Eglin AFB, the F-22
ing scenario from which
Flight Training Center at
data is recorded for later
Langley AFB, the F-16
review and analysis.
MTC at Aviano, Italy,
Welcome to the training
and the F-22 Advanced
environment known as
Combat Simulation
Live-Virtual-Construc-
center at Marietta, GA,
tive (LVC).
is beneficial because
Key to gleaning useful it enhances training
information on the train- analysis capabilities for
ing effectiveness of the both the Air Force and
The Performance Evaluation Tracking System developed by the 711th Human Performance Wing,
LVC environment is the its partners by being a
Warfighter Readiness Research Division, gathers data from live, virtual, and constructive training
Performance Evalua- events and measures warfighter performance and training effectiveness. multi-platform, multi-
tion Tracking System security performance
(PETS) developed by the 711th Human ciency has changed over time, or to reveal measurement system. By leveraging
Performance Wing, Warfighter Readiness where increased or targeted training may Cooperative Research and Development
Research Division. The PETS develop- be needed to address deficiencies. Agreements with multiple industry part-
ment team—psychologists specializing ners to streamline PETS integration into
PETS is a suite of tools at the core of a
in statistical, psychometric, experimen- existing training systems such as the
recently completed Category I Advanced
tal, industrial-organizational, and human LVC demonstration, Project Alpine II, at
Technology Demonstration with Air
factors psychology—consulted directly the Boeing facility in St. Louis last fall,
Combat Command called the Warfighter
with warfighters to identify constructs Air Force researchers sliced five years
Readiness Assessment and Performance
and metrics of importance to them. Thus, off industry-predicted development time
Measurement Tracking System (WRAP-
the system looks for data to measure the for demonstrating practical LVC capabil-
MTS). The human-centered performance
constructs of interest to researchers and ity. To respond quickly to the dynamic
measurement standards developed for
those measures that warfighters defined challenges of today’s operational envi-
WRAPMTS are being implemented in
as relevant. Software engineers worked ronment, warfighter training needs to be
the Combat Air Forces to support the Air
with the Warfighters to create the rule sets flexible, effective, and efficient. Feedback
Force migration to Proficiency-Based
and algorithms that PETS uses to filter from warfighters and researchers supports
Ready Aircrew Program (P-RAP) training.
the data. PETS data can be used to assess the conclusion that PETS and the underly-
learning, proficiency, and where the gaps “The PETS research program represents ing approach to human performance mea-
are in learning. This permits assessments a significant advance in pushing state-of- surement are sound, valuable
of the readiness “value” of live or virtual the-art measurement research and tech- contributions to improving
training hours because data are targeted to nology into the field,” said Dr. Winston warfighter readiness.
specific learning and readiness constructs, “Wink” Bennett, RHA technical advi-
are available in real time, and can be used sor for training and assessment research.
immediately for debriefing and assess- According to Dr. Bennett, PETS is not
ment. The data can also be saved and used only a foundation for the P-RAP initiative, Antoinette Portrey, Lockheed Martin
later to show how an individual’s profi- but the underlying measurement develop- Winston Bennett, Jr., 711 HPW/RHAS
Report Documentation Page Form Approved
OMB No. 0704-0188
Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and
maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information,
including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington
VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it
does not display a currently valid OMB control number.
1. REPORT DATE 2. REPORT TYPE 3. DATES COVERED
MAR 2009 Newsletter 01-01-2009 to 30-03-2009
4. TITLE AND SUBTITLE 5a. CONTRACT NUMBER
Fight’s On! Newsletter FA8650-05-D-6502
5b. GRANT NUMBER
5c. PROGRAM ELEMENT NUMBER
62205F
6. AUTHOR(S) 5d. PROJECT NUMBER
Gina Cinardo 1123
5e. TASK NUMBER
AS
5f. WORK UNIT NUMBER
09
7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) 8. PERFORMING ORGANIZATION REPORT NUMBER
Air Force Research Laboratory/RHA,Warfighter Readiness Research AFRL; AFRL/RHA
Division,6030 South Kent Street,Mesa,AZ,85212-6061
9. SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR’S ACRONYM(S)
Air Force Research Laboratory/RHA, Warfighter Readiness Research AFRL; AFRL/RHA
Division, 6030 South Kent Street, Mesa, AZ, 85212-6061
11. SPONSOR/MONITOR’S REPORT NUMBER(S)
AFRL-RH-AZ-NL-2009-0002
12. DISTRIBUTION/AVAILABILITY STATEMENT
Approved for public release; distribution unlimited
13. SUPPLEMENTARY NOTES
Volume 8, Issue II, Summer 2009
14. ABSTRACT
Newsletter contains the following articles: Portrey, A., & Bennett, W., Jr., The Warfighter Readiness Assessment and
Performance Measurement Tracking System Goes Operational; Neterer, J., Boyle, G., & Sims, D., eXpert Common Immersive
Theatre Environment Used as Joint Terminal Attack Controller Training and Rehearsal Threat Generator; Barrera, K.,
Coalition Live, Virtual, Constructive Operations and Training; Weeks, J., Instructional Science and Technology (S&T) for
Cyberspace Operations; Andrews, D. H., Cyber Friendly-Fire Avoidance Workshop (Cyber Fratricide Workshop); and
Barrera, K., Nellis Performance Assessment and Readiness Test and Training System Technology Transition Initiative Proposal.
15. SUBJECT TERMS
Warfighter Readiness Assessment and Performance Measurement Tracking System; WRAP-MTS; Live, virtual, constructive;
LVC; Cyberspace operations; Science and technology; Fratricide; Technology transition; JTACS; Coalition training;
16. SECURITY CLASSIFICATION OF: 17. LIMITATION OF 18. NUMBER 19a. NAME OF RESPONSIBLE
ABSTRACT OF PAGES PERSON
a. REPORT b. ABSTRACT c. THIS PAGE Public Release 4
unclassified unclassified unclassified
Standard Form 298 (Rev. 8-98)
Prescribed by ANSI Std Z39-18
eXpert Common Immersive Theatre Environment Used as Joint
Terminal Attack Controller Training and Rehearsal Threat Generator
Joint Close Air Support (JCAS) virtual trainer utilizing a full complement allows the JTAC to have situational
research at the Warfighter Readiness of weaponry from general purpose (GP) awareness of the battlefield to practice
Research Division 711 HPW/RHA con- bombs, artillery, and even today’s smart the visual and planning perspective with
tinues with the Joint Terminal Attack munitions. Range-per-munition, artil- no safety concerns to the participant. A
Controller (JTAC) Virtual Trainer (VT) as lery systems, max ordnance
the cornerstone of the JTAC Training and height, and the lethal range of
Rehearsal System (TRS). As the program munitions have all been accu-
moves from “proof of concept” to “opera- rately replicated in the threat
tional training effectiveness testbed,” database.
unique training challenges and shortfalls
The type of aircraft and
are being addressed.
enemy threat can also be
One of the challenges addressed by the selected from the hundreds of
JTAC TRS is the gap in live training and different air platforms, muni-
the ability to replicate a realistic scenario tions, and threat models. In a
in an immersive decision-making envi- more recent effort, the teams
ronment. The ability to create a realistic found that the XCITE data-
training scenario that drives the appropri- base can also be used to stim-
ate decision-making process for a JTAC ulate the Multiple Unified
is complex. Previously the only way to Simulation Environment/Air
accurately task saturate a JTAC was during Force Synthetic Environment
conflict because the ability to control direct for Reconnaissance and Sur-
and indirect fire via fighter aircraft, artil- veillance (MUSE/AFSERS) View of the battle space
lery, attack helicopters, and Unmanned to provide the JTAC a simu-
Air Vehicles (UAV) was rarely rehearsed lated Remotely Operated Video Enhanced trainee can see in advance whether restric-
on a training range. This is due to range Receiver feed. tions or other criteria would put an asset
restrictions, safety concerns, lack of at risk, adjust engagement zones and
assets, air space, and realistic train- airspace considerations, and create a
ing resources. The JTAC controls different outcome that would better
a two-ship of attack aircraft onto suit the mission.
preplanned, static target sets. In a
The JTAC can then use his know-
combat setting, however, a JTAC is
ledge and training to select the
expected to plan Close Air Support
appropriate munition to carry out
based on the ground commanders
the commander’s intent. Buildings,
intent and asset availability, sup-
civilians and other urban type infra-
press enemy air defenses, deconflict
structure models can be included into
airspace, and conduct target analysis
the training scenario to complicate
while minimizing collateral damage
the decision-making process. The
and assessing the risk to friendly
impact of being able to practice such
forces.
a dangerous situation can refine tac-
In an effort to provide a realis- tics and procedures and potentially
tic and immersive environment to reduce risk to the warfighters during
fill the training shortfalls, the JCAS conflict. It also helps create a better
team relies on 711HPW/RHA’s UAV view from MUSE/AFSERS on the IOS understanding of the complexity of
eXpert Common Immersive Theater combining fires during war-
Environment (XCITE) team to provide So, why is the threat system so impor- time so that the JTAC is not
a threat system with constructive bat- tant in a simulated environment? The abil- employing mass fires, for the
tlespace models. Utilizing the JTAC VT’s ity to task saturate a JTAC in a training first time, in combat.
visuals and XCITE’s physics-based threat environment so that he is ready and able
models, the team is closing the training to employ the appropriate decision-mak-
gaps that cannot be adequately repre- ing process in combat is key. The XCITE Lt Jonathan Neterer, 711 HPW/RHAE
sented or trained to in a live setting. A database provides the appropriate combat Mr. Garry Boyle, 711 HPW/RHAE
training scenario can be developed in the threat models. The fully immersive dome Mr. Danny Sims, L-3 Communications
Coalition Live, Virtual, Constructive Operations and Training
The Live, Virtual, and Constructive (LVC) Training Research plans to install a 5-meter Joint Terminal Attack Controller-Train-
Team was awarded a $1.4M Coalition Warfare Program (CWP) ing and Research System, develop a coalition version of the Per-
proposal for FY10 and FY11. The RHAS Continuous Learning formance Evaluation Tracking System, and demonstrate UK LVC
Branch was awarded a two-year effort to work with the United operations between live assets and virtual players. The system
Kingdom’s (UK) Defense Science and Technology Laboratory will be used by DSTL and the ABTC to investigate the use of LVC
(DSTL) and the Mission Training through Distributed Simulation operations with our foreign partners as well as research how oper-
at the Air Battlespace Training Centre (ABTC), Royal Air Force ational personnel can use LVC technology. Use cases and best
(RAF) Waddington to further coalition LVC training. The team
Continued on page 3
C-LVC OT Continued from page 2 real-time simula-
tors including both
practices will be developed and the foundation for coalition LVC
warfighter-in-the-
operations and training (C-LVC OT) will be established. The
loop (virtual) and
C-LVC OT program will create a unique training environment,
computer-gener-
where all players - US air and ground, as well as coalition part-
ated (constructive).
ners - are provided quality training including mission planning,
Using developed
briefing, execution, and debrief whether they are flying a live air-
Mission Essential
craft or participating in an air or ground simulation environment. CompetenciesSM
C-LVC OT will also be a proving ground for joint and coalition – key knowledge
training, rehearsal, and exercise interoperability standards devel- areas and skills to
opment, validation, and refinement. be trained – air-
crews can use data
The goal of LVC operations is to provide warfighters in live air- Long-haul asset links Cross-Domain secure inter-
collected from live
craft the same complex combat environment and detailed replay play to support 4th and 5th generation training,
and virtual mis-
and debrief tools as pilots in Distributed Mission Operations sim- rehearsal, and exercise
sions to demon-
ulators. Both US Air Forces in Europe (USAFE) and the UK’s
strate quantitative mission performance metric tracking. 711
RAF are developing networks for linking virtual and construc-
HPW/RHA took the lead in developing LVC enabling technology
tive simulations. Based on the cooperative research agreement while integrating the training aspect into a more robust debrief.
between 711 HPW/RHA and UK’s DSTL, the proposed LVC Data captured highlight numerous data points that were previ-
operations program will link USAFE and RAF simulator net- ously unobtainable during live-fly events. With the CWP effort,
works and attempt to incorporate live assets into networked train- a coalition version of the program will be developed
ing exercises. LVC operations have been developed at 711 HPW/ further aiding the training and debriefing capability
RHA as a demonstration case for integrating and evaluating two- of our allies.
way communication and data transfer between live aircraft and Ms. Kristen Barrera, 711 HPW/RHAS
Instructional Science and Technology (S&T)
for Cyberspace Operations
initiated Science and Technology (S&T) reality.
to address these needs. The goals of the
Personalized learning is individually-
S&T are to accelerate learning and shorten
tailored instruction; the gold standard for
the training process.
which is one-on-one tutoring. It has been
Cyberspace operations are unique in that empirically verified through replicated
information technology changes rapidly. experimentation that consistently, on aver-
To accelerate knowledge and skill acquisi- age, individuals who receive one-on-one
In December 2007, the Heritage Foun- tion to match rapid changes in technology, tutoring perform two standard deviations
dation reported that during fiscal year we need an agile training enterprise based greater than individuals trained through
07 the Department of Homeland Secu- on learning-by-doing with individualized conventional classroom instruction. That
rity received 37,000 reports of attempted instruction. In addition, special support is is a huge advantage in favor of one-on-
cyber attacks on government and private needed for the learner. Although top-level one tutoring, but it is too costly to imple-
computer systems. The Foundation also outcomes from cyber attack are observ- ment on a grand scale. The engineering
reported more than 80,000 attempted able, underlying processes are not. This challenge of personalized learning is to
attacks on Department of Defense com- unique feature of cyberspace operations make one-on-one tutoring affordable by
puters and networks. In April 2009, CBS suggests development of visualizations applying the power of computer automa-
reported Defense Secretary Robert Gates and animations to represent unobservable tion to trainee performance measurement,
as saying “...the United States is under cyber processes to accelerate learner com- performance evaluation, feedback, devel-
cyber attack... all the time... every day...... prehension. opment of exercise scenarios, and learning
and the Department plans to quadruple the management.
Research questions include:
number of cyber security experts to ward
off attacks.” The Federal Bureau of Inves- • Can we accelerate learner compre- The second engineering challenge is
tigation has identified cyber attack as the hension by using visualizations and advancing virtual reality, which includes
third greatest threat to the United States animations for unobservable cyber developing realistic virtual environments
after nuclear war and weapons of mass processes? and simulators for learning-by-doing. If
virtual training environments satisfy the
destruction. • Can we accelerate learning by using
goal for realism, trainees would have a
United States Strategic Command individually-tailored instruction? déjà vu experience when they take their
(USSTRATCOM ) and USAF Air Combat • Can we accelerate “learning-by-doing” place on the operational line.
Command (ACC) have expressed needs with realistic virtual training environ-
This S&T will lead the way in revolu-
related to cyberspace operations training. ments?
tionizing education and training for cyber-
USSTRATCOM has requested tools to
In addition to research questions, there space operations and spin off advanced
shorten and streamline the training pro-
are key engineering challenges. In 2007, training technology for other
cess and ACC has requested a training
the National Academy of Engineering skills. Most importantly, it
range for realistic network warfare opera-
identified fourteen grand challenges for will help address a major
tions.
the new millennium, two of which are threat facing the United States.
As a result, the 711 HPW/RHA War- relevant for this S&T. These are: per-
fighter Readiness Research Division has sonalized learning and advancing virtual Dr. Joseph Weeks, 711 HPW/RHAS
Cyber Friendly-Fire Avoidance Workshop (Cyber Fratricide Workshop)
On 3-4 February 2009, the 711th Human fire accidents? adversary targets versus unintended con-
Performance Wing and the Information sequences of routine maintenance and
The workshop had six working groups:
Directorate of Air Force Research Labora- defense of friendly targets. In addition,
• Community of Practice (who’s who)
tory organized and hosted a workshop on workshop participants identified several
cyber friendly-fire avoidance. The objec- • Taxonomy (definitions) S&T challenges to reduce cyber fratricide
tive of the workshop sought to understand • Research Thrusts (where should we and lessen its impact. The consensus from
the prevalence of cyber friendly-fire,
invest) the workshop attendees was that the topic
define a taxonomy, and develop a research
• Intelligence Gain/Loss is important, and they would like to see
direction to study the subject.
the workshops continue. AFRL plans to
• Technical Forum
The workshop explored: host another workshop in September 2009
• Human Factors Analysis
• How prevalent is cyber friendly fire? and will expand the invited attendees to
The workshop participants included include more organizations from outside
• What are case examples of real world
speakers and representatives from AFSPC/ the Air Force.
instances?
A3, 608 AOC/CC, 26 NOG/CC, AFRL/
Persons on call for the workshop were
• What are the root causes? XPC, AF/A30-C, AFSPC/AC, AFOSR,
Dr. Dee Andrews, Senior Scientist, Train-
• What are possible mitigating solu- AFIT, AFSPC/A8, Pacific Northwest
ing Psychology, 711 HPW/RHA, and
tions, both technical and human fac- Laboratory, and Georgia Tech Research
Dr. Kamal Jabbour, Senior Scien-
tors, for cyber friendly fire? Institute.
tist, AFRL/RI.
• Are there cyber analogs of the Blue Findings included the requirement to
Force Tracker technology that have differentiate between unintended con-
helped to mitigate physical friendly sequences of offensive action against Dr. Dee Andrews, 711 HPW/RHA
TARGETS OF OPPORTUNITY
Nellis Performance Assessment and Readiness Test and
Training System Technology Transition Initiative Proposal
The Nellis Performance iting the need for instrumentation
Assessment and Readiness Test of the airframe. Linking in other
and Training System (NPARTTS) virtual type players such as the
Technology Transition Initia- Joint Terminal Attack Control-
tive was written with HQ ACC/ ler Training Rehearsal System
A8A to transition a performance at Nellis into the NPARTTS
assessment and readiness test will add an additional training
and training system to the Nellis dynamic at Nellis AFB. The
Range. This system will facili- effort is supported by the Office
tate performance based debrief of the Secretary of Defense (Per-
capabilities for both live and sim- sonnel & Readiness), HQ ACC/
ulated aircraft on the Nevada Test A8, and offices within the 4th and
and Training Range (NTTR). By 5th generation program. This is
integrating several lab technolo- seen as a risk reduction effort
gies within the NTTR infrastruc- to further integrate live, virtual,
ture, the overall system will and constructive entities
Bidirectional communication between live and virtual assets.
enable live and simulated aircraft within the Combat Air
flying on the NTTR to conduct Force.
more in-depth debriefs. The range infra- gies by laying the ground work for transfer
structure will create test and training syner- of onboard aircraft data to the ground lim- Ms. Kristen Barrera, 711 HPW/RHAS
Fight’s On! is published by the Warfighter Readiness Research Division
711th Human Performance Wing / RHA of the Air Force Research Laboratory Human Effectiveness Directorate
6030 S. Kent Street, Mesa, AZ 85212-6061.
Fight’s On! Point of Contact:
Ms. Gina Cinardo, 480-988-6561 x 589, DSN 474-6589 and e-mail [email protected]
PA Approval No. 88ABW-2009-3572