Training Needs Analysis (TNA) - Description of TNA process - used in
defence, military (aviation / air, land, sea) and safety critical (e.g. rail, road transport, nuclear) domains.
Scoping Study
The purpose of a scoping study is to provide information to support the conduct of a TNA. It includes information relating to TNA management, areas of risk, policies, assumptions, constraints and personnel affected by the requirement. It also highlights issues which might impact on, or will need to be considered during, the TNA.
Our approach to conducting scoping studies is to provide the context and level of detail that we would want as TNA analysts (e.g. detailed target audience description, HFI risk assessment), together with requirements specified in applicable TNA documentation (e.g. DTSM 1 and 3,
BR 8420, JSP 502 etc.).
We used this approach to successfully conduct a tri-service scoping study for Project Listener on behalf of the UK MoD\s JSENS Integrated Project Team.
Operational Task Analysis
The purpose of the Operational
Task Analysis (OTA) is to establish and prioritise the operational tasks, the conditions under which each task is to be performed and the standards required to be demonstrated by competent personnel, for all members of the target audience.
Air Affairs uses a combination of hierarchical task analysis (HTA) and cognitive task analysis (CTA) techniques to identify task requirements, task sequencing, human-equipment interactions and human-human interactions.
We work closely with subject matter experts (e.g. end users, system designers) in order to conduct the OTA.
Training Gap Analysis
The purpose of the Training Gap
Analysis (TGA) is to identify gaps between the level of performance achieved by existing training and the new performance standard identified during the OTA. We draw on our human factors, training and occupational psychology experience to tailor TGA processes as needed.
For example, we have exploited our competency research in the conduct of Knowledge, Skills and Attitudes (KSA) analyses to improve definitions of required individual and team competencies.
Traditional fidelity analysis methods are very time-consuming, highly subjective, and difficult to critically evaluate. We have developed an alternative method, which identifies the characteristics of tasks (e.g. component location, component selection, skills integration), and associates fidelity levels with these characteristics, rather than with the tasks themselves. Task fidelity requirements become composites of their characteristics, improving inter-rater reliability across tasks and reducing subjectivity. This approach avoids lower fidelity demands (e.g. for knowledge-based characteristics) becoming ‘hidden’ by more demanding task characteristics, which in turn permits accurate quantification of low and high fidelity training solutions. This approach also permits the characteristics required of suitable training media to be explicitly defined by the fidelity analysis. This approach has been validated by several UK and international TNAs.
From our competency work, we have developed a methodology for assessing the risk of skill decay associated with each task, and identifying the appropriate refresher training intervals required to mitigate this risk. Our approach considers multiple factors, including task criticality, task type (cognitive and physical), training-to-performance lag time, equipment and frequency of performance. Results of this analysis are used to support downstream assessment of media demand, and to ensure that refresher training is appropriately targeted to minimise competence deterioration.
Training Options Analysis
The purpose of the Training
Options Analysis (TOA) is to recommend the most cost effective training solution to meet the identified training requirements.
At Air Affairs we have developed a model for quantifying all of the key resources (including media, facilities and instructors) required to support the training need. The calculation considers factors that might affect media and resource numbers including trainee throughput, time on media, availability of resources, training days available. The model has been used successfully to support a number of TNAs for UK and overseas military clients.
To support the Cost Benefit Analysis within TOAs, we have developed a database which allows us to record and reuse data relating to capital, manpower, infrastructure and support costs over the projected life of a training system. This database can be tailored to meet the particular requirements of a study.
Following the TOA, a final report is produced. This stand-alone document specifies the training requirements, identifies the recommended training strategy and resources required, and provides details of the recommended training implementation and Post Project Evaluation (PPE) strategy.
Air Affairs is an independent,
specialist provider of
Training Needs Analysis (TNA)
studies to clients across
defence (not just
tri-service military aviation)
and safety critical civilian
sectors.
TNA is a structured investigation into the performance and training requirements resulting from the introduction of new systems or changes
to working practices, together with identification of the most cost effective methods and media needed to address
them.
Historically, procurement was
largely equipment-driven,
resulting in TNAs which
concentrated on
individual operator or
maintainer skills, and which
focused on events at the human-machine
interface. This approach is
still relevant, but by itself
will fail to
adequately represent or address
real-world performance and
training needs for anything but
the most basic requirements. Modern
capability-driven procurements
increasingly place humans within
complex systems, in which
consideration is required of
more varied physical and mental
skills by, and between,
individuals and teams. Effective
TNAs therefore demand a range of
human factors skills and
techniques, and the ability to
adapt the training analysis process as
needed.
We have extensive experience in the conduct of
large and complex systems-based TNAs. We have undertaken
individual, team and collective
analyses in safety critical
domains including military land,
sea and air, road, rail and
nuclear energy, in the UK and overseas. Our studies have considered all aspects of training that might be required,
such as initial,
continuation, refresher, upgrade,
mission rehearsal.
In
order to recommend the most
cost-effective training
solutions, we use a
comprehensive analysis process.
It identifies the training
requirements, evaluates media
options, objectively
quantifies resource demand,
and specifies fully-costed training solutions.
This information can be used as
the basis for traditional procurement
decisions, or as a baseline to
underpin tender evaluation and
supplier selection activities in PFI
procurements. The process can be
tailored to meet client
requirements, whilst complying
with relevant mandatory
standards and formal methods
(such as the Defence Systems
Approach to Training (DSAT)
Quality Standard and its
supporting Defence Training
Support Manuals (DTSM), JSP 502, JSP 822
etc.).
Air Affairs has undertaken large
and small TNA studies,
ranging in duration
from a few
weeks to a year or longer. For
example, we conducted a major
TNA for the
UKMFTS Integrated Project Team.
Lasting approximately 18 months,
the TNA defined the training
requirements for 19 tri-service
aircrew roles and fast jet
flying instructors, and identified quantified, costed training and assessment solutions to inform
the PFI procurement.
The diagram below identifies the
steps in a 'typical' TNA. Roll the mouse over each
step for further details.
focused on events at the human-machine
interface. This approach is
still relevant, but by itself
will fail to
adequately represent or address
real-world performance and
training needs for anything but
the most basic requirements. Modern
capability-driven procurements
increasingly place humans within
complex systems, in which
consideration is required of
more varied physical and mental
skills by, and between,
individuals and teams. Effective
TNAs therefore demand a range of
human factors skills and
techniques, and the ability to
adapt the training analysis process as
needed. 
from a few
weeks to a year or longer. For
example, we conducted a major
TNA for the
UKMFTS Integrated Project Team.
Lasting approximately 18 months,
the TNA defined the training
requirements for 19 tri-service
aircrew roles and fast jet
flying instructors, and identified quantified, costed training and assessment solutions to inform
the PFI procurement.