SkillGrader is an application that allows an organization to simply and objectively evaluate the performance of any observable skill, whether it is done during training, as part of regular drills, for certification, or as a regular part of on-the-job performance. It replaces paper based assessments, which are inherently subjective, with a technology-based solution that provides an immediate skill assessment report. It also electronically stores all assessment results for future reference, to support audits, and to help reveal workforce trends, gaps, and metrics for continuous improvement.
First, an assessment form is created by the organization’s experts for the skill being assessed. These electronic forms follow a particular format which makes them highly objective, meaning that different assessors will produce consistent assessment results.
When preparing to assess a skill, the observer chooses the corresponding form on the SkillGrader app, and then selects the individual or team members who are about to demonstrate the skill. As the skill gets underway, the observer simply clicks the appropriate button each time they see an individual perform an action listed in the form. The observer does not need deep expertise, as is the case with paper-based forms. With SkillGrader, the expertise is built into the form by the company experts and the observer simply marks actions as they are performed.
From this simple input data, SkillGrader uses a sophisticated algorithm to generate an instant report grading the performance of the team and the contribution of each individual to that team effort. Gaps are identified and strengths are highlighted. All the raw data is transferred back to the central server for secure storage and further analysis of trends and other cross-assessment insights.
SkillGrader was initially developed as a collaboration between Marine Learning Systems and the training and assessment experts at our largest customer, the Carnival Group of cruise lines. The original goal was to support a sophisticated competency framework and performance-related training. This required a way to simply, objectively and deeply assess skills for teams and individuals, and to generate skill performance metrics for the workforce as a whole. The use of early prototypes at Carnival proved that obtaining deep and objective metrics on skill performance was indeed possible. Simplifying the process also greatly expanded opportunities for assessment helping to shed light on what is arguably the most important question of safety and performance: does our workforce perform their duties according to company best-practice?
Prior to the development of SkillGrader, the industry best practice for skill assessment was to have an expert use paper-based forms to assess individuals. There are several issues with this approach.
First, paper assessments led by an expert tend to be subjective: two assessors may have different viewpoints or disagree on the level, or grading, of skill displayed. The result is that assessments cannot be reliably compared to one another to analyse trends. SkillGrader eliminates almost all subjectivity by asking the observer to simply record who performed specific actions listed on the electronic form. SkillGrader then uses an algorithm compute the assessment results. This means that assessors don’t require a high degree of expertise to evaluate personnel – which is why we now call them observers.
Second, in addition to making assessments more objective, reducing the expertise required of the observer also creates far more opportunities for assessment. With SkillGrader, any training event, drill, on-the-job activity or certification process becomes an opportunity to assess skills and gather data. This provides the organization with a clearer and more complete picture of abilities, gaps, skill fade and procedural drift.
Finally, the paper-based approach means that any data collected was “locked” on paper. Time-consuming data entry was needed to convert the “paper data” into digital data for deeper analysis. Instead, SkillGrader records all data in a database making it possible to report on trends, identify workforce leaders, reveal organizational risks, and perform cross-skill evaluations of individual employees.
Yes! SkillGrader is available for all maritime operators. Contact us today and be one of the first to elevate your skills assessment process.