What is SafeMetrix?
Technical skills are essential for seafarers, but there is also a need to ensure they have the right personal attributes and characteristics for the role they are in. Sadly, many tragedies at sea have been caused by a failure in decision-making or assertiveness rather than lack of experience or knowledge.
Our psychometric assessment platform SafeMetrix is our response to the challenge of marrying technical and non-technical skills. It helps those involved in the recruitment and career development of seafarers to better understand and quantify the non-technical skills seafarers should possess to ensure their wellbeing and safety, and to develop into high performing and competent crew.
What are psychometric assessments?
Psychometric assessments are used in a wide range of settings to help understand and predict behaviour. They make inferences about an individual based on a sample of behaviour. They identify the extent to which someone’s skills and abilities match those required to perform specific duties.
Psychometric assessments help to identify and measure skills which cannot be accurately extracted and assessed during a face-to-face interview, and also mitigate against biased and unsubstantiated decisions. When applied appropriately, they can serve as an essential component of the crewing process and increase the safety and efficiency of operations onboard.
How do psychometric assessments help recruitment and development decisions?
The assessments allow HR, crewing and training managers to ensure a candidate is suited to a role by assessing characteristics that are not visible on a CV or demonstrated during an interview. For example, they would want a captain to show strong leadership while lower ranks need to demonstrate an ability to follow instructions. Since all candidates are objectively assessed, companies gain reliable and accurate information to make hiring decisions.
In addition to recruitment, companies can also use psychometric assessments to identify seafarers who possess higher level abilities and are suitable for promotion. Psychometric assessments can also help identify specific areas that require training in order to design and implement well-targeted training programmes, rather than assuming everyone needs the same training.
What kinds of assessments do you offer?
We offer two types of psychometric assessments to assist crew and HR managers to make recruitment and employee development decisions.
· MET-3S (Soft Skills for Seafarers) assesses the soft, non-technical skills of the crew, covering three clusters of skills - coping under pressure, interpersonal skills, and self-management.
· MET-CSS (Cognitive Skills for Seafarers) assesses a series of key cognitive functions which are required for optimal performance and ensure a safe work environment.
What are soft skills and why are they important in maritime?
Soft skills are non-technical skills that make people who they are, rather than what they know. They are characteristics, competencies, and attitudes that provide insight into how an individual seafarer may cope under pressure, self-manage and other react towards work situations and colleagues. Technological advances on board, such as artificial intelligence, sees a shift in job requirements. Soft skills augment automatic processes to enable safer and more efficient operations.
What are cognitive skills and why are they important in maritime?
Cognitive skills refer to how the brain processes stimuli. They refer to the ability of people to acquire, perceive, process, store and project information. These skills are becoming increasingly important as the maritime industry embraces new technologies and the complexity of the work environment increases. Seafarers now require a greater level of situation awareness.
How many skills are assessed in each assessment?
MET-3S assesses 13 essential skills for each rank, grouped into three clusters of ‘coping under pressure’, ‘self-management’ and ‘interpersonal skills’. MET-CSS assesses 4 essential skills for each rank.
How do you know what skills seafarers need?
A robust methodology was used to analyse the specific job requirements for the various ranks on board and we conducted a thorough job analysis to identify the skills considered most important and in demand.
How do I know the assessments will benefit my organisation?
We worked with maritime industry experts to ensure the assessments and the SafeMetrix platform were of the highest quality. The assessments were tested against three main criteria:
· Reliability – The test needs to be stable for up to two years without changes.
· Validity – The test needs to be valid to the profession, skills and conditions.
· Fairness – The test needs to be void of gender, culture, age, race implications.
SafeMetrix assessments were checked for all these factors and were found to provide crew operators with valid and reliable data on which to make decisions. They are created in such a way that the seafarers’ language or culture do not affect the results.
How are the assessments scored?
SafeMetrix assessments are norm-referenced which means that they provide information on how the test takers’ scores compared to other people that are included in the same group within the seafarer population.
Each test taker will receive a stanine score for each skill scale, which will be in the range from 1 -9. It indicates how well the participant performed in comparison to others in the group. Stanines can be categorised as:
· Below Average (1-3)
· Average (4-6)
· Above Average (7-9)
SafeMetrix offers three options to calculate the scores of an individual:
· Comparison based on the industry norm (by default).
· Comparison based on the company norm: the system allows comparison based on company norms if there are at least 1,000 results.
· Comparison based on the nationality norm: the system allows comparison based on nationality norm and are considered informative only if there are at least 100 results.
How do I interpret and understand the assessment results?
SafeMetrix provides three different reporting mechanisms to provide managers with a comprehensive and easy to understand break down of the results.
· Lite Report –a brief, standardised two-page report that presents results of the individual against others in their cluster with short interpretations for each skill score.
· Extended Report - the results per cluster are presented along with other ways to visualise how results are distributed, with extended interpretations of each skills scale result.
· Integrated Report –includes the results of both MET-3S and MET-CSS along with an overview of all the results, reviewed by a certified psychologist. It also includes recommendations, such as interview guidelines of how to conduct follow-up interview to countercheck potential weaknesses and/or possible drawbacks.
Are all the reports available on the platform
Both the Lite and Extended reports can be automatically generated directly on the SafeMetrix platform and are included with the license, but an additional license must be purchased for the Integrated version. Further information about costs and process for the Integrated report is available from our sales department on [email protected]
or by calling +357 25001490.
Are SafeMetrix assessments rank-specific?
We offer soft and cognitive skills assessments for the following ranks:
· Management Level Deck officers
· Operational Level Deck officers
· Management Level Engine officers
· Operational Level Engine officers
The company Admin can select the assessment type they want to assign, allowing the test taker to be compared to other people in the same group. This means results are valid and reliable.
In what languages are the assessments available?
All assessments are available in English. MET-3S assessments are also available in Russian, Greek and Tagalog (Filipino) for Management Level Deck officers, Operational Level Deck officers.
What is the average time needed to complete the assessments?
The average time for completing the MET-3S is about 45 minutes. The average time for completing the MET-CSS is around 35 minutes.
How long are the assessments valid for and how often should they be repeated?
MET-3S (Soft Skills for Seafarers) is valid for 24 months and should be retaken afterwards to reflect the current level of the soft skills of the seafarer. MET-CSS (Cognitive Skills for Seafarers) is valid for four years and should be retaken after this period ends, to reflect the current level of the cognitive skills of the seafarer
In what format is the MET-3S assessment?
Each MET-3S assessment consists of 150 statements to which the test taker must indicate if they agree or disagree. There are different levels of agreement, and the assessment will analyse the results based on the industry norm.
In what format is the MET-CSS assessment?
The number of correct responses (accuracy) and the response time (speed) are the two basic measuring factors. In all the skill sub-surveys, the system identifies and records the responses of the seafarer. In this way, the correct and incorrect answers are calculated, and the total number of correct responses in each of the four sub-surveys is taken into consideration. The response time in all items and all the sub-surveys is calculated. The clock starts when an item is presented on the screen, and the clock stops when a response is given.
How do I purchase new assessments?
You can purchase new assessments through the Safebridge Webshop under the Business Only Products category. Alternatively, contact our sales team on [email protected]
or telephone +357 25001490 for a demo and information on how to purchase and use the product.
Are there any other products that can help me manage the assessment process?
We recommend conducting follow-up interviews to further assess and countercheck the results of the assessment. SafeMetrix Competency-based Interview Guidelines training course guides HR managers in how to conduct effective seafarer interviews that lead to an objective comparison of individuals.
The course teaches how to identify critical elements in the responses of candidates through competency-based interviewing:
· Asking a specific set of job-related questions
· Using a specific set of predefined indicators for evaluation
· Using rating scales for evaluation
On completion of the course, learners will receive a PDF copy of the Competency-based Interview Guidelines Template to support future interviews.
What if the assessments highlight gaps in seafarer skills and training?
We offer a range of soft and cognitive skills training and the SafeMetrix Personal Development package includes unbounded licenses. The package can be purchased and individual courses can be assigned to each seafarer to address potential weaknesses and initiate personal development. These training courses can be also purchased individually or as a bundle through the Safebridge Webshop.