Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) 2005
Automating Hand Signal Recognition:
Transforming Helicopter Signaling Skills Training
John W. Ruffner, Ph.D., Dmitry E. Shiraev, Peter A. Morey, Jim E. Fulbrook, Ph.D.,
Andrew D. Struckhoff, DCS Corporation, Alexandria, VA
Thomas M. Franz, Psy.D., NAVAIR - Orlando Training Systems Division, Orlando, FL
Abstract
In 2006 the United States Navy will acquire four new Vertical Flight Deck Training Systems (VFDTS) that
combine virtual reality simulation of helicopter shipboard landings, takeoffs, and over-deck operations with
an automated Hand Signal Recognition System (HSRS), effectively transforming how and where initial
helicopter signaling skill acquisition and refresher training before or between deployments can be
conducted. In this paper, we describe the development and evaluation of the HSRS and discuss training
issues and challenges faced by the project team. We identify instructional design issues and suggest some
future HSRS capabilities and applications. Finally, we discuss links to the Department of Defense Training
Transformation Initiative.
ABOUT THE AUTHORS
Dr. John W. Ruffner is a Human Factors Engineering Psychologist and a Board Certified Human Factors
Professional with DCS Corporation where he is a Senior Scientist and Technical Advisor for Human
Factors and Training. He received a Ph.D. in Industrial/Organizational Psychology and an M.S. in
Experimental Psychology from Iowa State University. He has over 30 years experience in human factors
research and development and test and evaluation (RDT&E) in training development, night vision systems,
and human system integration for a wide variety of aviation and ground systems. He has over 100
publications, conference proceedings papers, presentations, and reports.
Dmitry E. Shiraev is a Computer Scientist supporting design, development, and integration of software
systems at DCS Corporation. He has an M.S. in Computer Science and Applications and B.S. degrees in
Computer Science and Mathematics from Virginia Tech. Mr. Shiraev is currently providing software
engineering support for the Hand Signal Recognition System project
Peter A. Morey is a Systems Engineer for the Electro-Optical Design and Engineering Branch at DCS
Corporation. He has a B.S. in Imaging Science, with a minor in Electro-Optics (E-O), from Rochester
Institute of Technology. Mr. Morey’s professional specialties are in optics, digital image processing, and
software development. He is the lead E-O engineer for the Hand Signal Recognition System project.
Andrew D. Struckhoff is a Systems Engineer and Technical Advisor in the Electro-Optical Design and
Engineering Branch at DCS Corporation. He has 15 years experience in the development, analysis, test and
operation of machine/computer vision systems, E-O systems, E-O calibration, software design and
development, and real-time image processing algorithms.
Dr. Jim E. Fulbrook is a Human Factors Engineer with DCS Corporation. He received a Ph.D. in
Neurobiology and an M.S. degree with specializations in vision research and learning theory from the
University of Delaware. He has over 25 years experience in research psychology and human factors and is
a former Army helicopter pilot and flight instructor. He has published over 30 papers and reports.
Dr. Thomas M. Franz is an Industrial/Organizational Psychologist working as a civilian for the last 15
years at the United States Navy's NAVAIR Orlando Training Systems Division. Prior to that he served a
pre-Doctoral Internship at IBM’s Management Development Center in Armonk, NY, and a post-Doctoral
Fellowship with the Navy. Dr. Franz teaches evenings and on-line for Columbia College of Missouri.
His degrees are from Central Michigan University.
2005 Paper No. 2171 Page 1 of 8
