Published on Australian Maritime Safety Authority (https://www.amsa.gov.au)



Evaluations—STCW certificate of competency/proficiency and short courses—MT04

Our process for conducting Registered training organisation evaluations.

The purpose of this procedure is to:  

Background

We as the Flag State designated approving Authority must make sure that approved courses meet the appropriate STCW Convention and national standards by a formal evaluation process using industry accepted evaluation standards and processes as required by STCW Regulation l/8.

The national standards recognised by us for our approved Registered training organisations are:

We will conduct evaluations of our approved Registered training organisations to ensure compliance with ASQA and TEQSA Standards and will focus on STCW Regulations l/6, l/8 and l/12 and compliance of standards included in these Regulations. Our approved Registered training organisations must also incorporate these Regulations in compliance with these Standards.

Scope

This procedure details the process which our personnel authorised to conduct evaluations should follow when evaluating maritime training programs offered by an Registered training organisation to those who are seeking to gain a maritime certificate. It also includes information how to gain and maintain a certificate of course approval from us.

Definitions

Read Definitions for Registered training organisations delivering STCW AMSA approved courses—MT01.

Associated documents

In the case of the Australian Maritime College (AMC), reference should be made to the accredited curriculum documents.

Evaluation processes

1. Initial evaluation and issue of a Certificate of approval to Registered training organisations 

2. Certificate of approval

A Certificate of approval may be issued for a maximum of five years. The Certificate will be issued subject to such conditions as determined by us. These conditions will include but are not limited to:

The Registered training organisation maintains all requirements for initial issue of the certificate.

Surveillance evaluations are allowed to be conducted.

The Registered training organisation must notify us of any changes to the system of quality control, training programs, change of lecturers, facilities and any event that may affect the quality of the program.

There will be a maximum of twelve participants for practical fire fighting and survival sessions, unless otherwise authorised by us.

Course instructors are to be approved by us.

3. Surveillance and renewal evaluations

Surveillance and renewal evaluations will take the form as outlined below. We will conduct unscheduled evaluations when we consider it necessary to verify the course standard.

Our approved Registered training organisations which deliver the Diploma, Advanced Diploma or Degree level STCW courses will be evaluated annually. All other approved Registered training organisations which deliver STCW short courses will be evaluated biennially using a risk based approach. These evaluations must be conducted within three months either side of the anniversary date of the issue date of your Certificate of approval.

If a renewal evaluation is conducted within three months before the expiry date of the certificate then a new certificate may be issued for a maximum of five years from the expiry date of the existing certificate.

Applications for renewal evaluations must be in writing and must be received by us no later than 90 days before the Certificate expires.

If a Certificate of approval becomes invalid, you will not have approval by us to conduct the maritime training course(s).

4. Evaluation process

We will, where possible, conduct combined evaluations with the ASQA auditors to minimise disruption from the evaluation process. Our evaluator(s) must ensure that the Registered training organisation under evaluation meets all of our requirements. The evaluation will be conducted within the requirements of the ASQA standard.

Where our approved Registered training organisation conducts engineer and deck training, both the PANC and PAEC should, where possible, conduct the evaluation; one  will be appointed as Lead evaluator.

Where a Registered training organisation conducts specific training, then only the appropriate Principal should conduct the evaluation.

In circumstances where the appropriate Principal is not available, our appointed evaluator approved by the Manager may conduct the evaluation.

It is our standard practice to conduct annual  evaluations of Registered training organisations who provide STCW Certificate of Competency courses and biennial evaluations of those Registered training organisations providing STCW short courses. If there are major non-conformances identified or we have concerns regarding the standard of a course(s) then the approval period may be reduced as determined by the Manager.

Other factors which may lead to an increase in evaluation frequency include:

If the Manager determines that circumstances require a non-scheduled evaluation to be conducted, the Head of school (or similar) of the Registered training organisation will be contacted and informed of the reasons for the additional evaluation and the date when it will occur.

5. Evaluation preparation

Prior to starting an evaluation the Lead evaluator must complete the following tasks:

6. Conduct of the evaluation

On arrival at the Registered training organisation the Lead evaluator must arrange a meeting with the Head of School (or similar) prior to the commencement of the evaluation to make formal contact.

The Lead evaluator will conduct an opening and closing meeting with relevant Registered training organisation staff members.

Evaluators are to collect information through interviews, examination of documents, observation of work being performed and work conditions in the area being evaluated. Evaluators are to note non-conformances and observations when they are identified.

The scope and depth of the evaluation is to be sufficient to determine adequate compliance with regulatory requirements, relevant industry and academic standards and the Registered training organisations own quality system.

During the evaluation, evaluators will:

7. Opening meeting

The opening meeting should commence at the agreed time, and where practicable, with all persons involved in the evaluation present. During the opening meeting the Lead evaluator will give an introductory talk and cover the following items:

8. Non-conformance findings and observation notes

Non-conformance findings

The evaluator is to classify any clearly identified irregularity against a specific requirement as a non-conformance and is to be stated as a non-conformance finding verbally at the closing meeting.  The non-conformance is to be formally issued to the Registered training organisation  in the evaluation report. All non-conformance findings are to be recorded in a clear and concise manner, supported by objective evidence and recorded against a procedural requirement – there must be no ambiguity.

Examples of irregularities which may reflect a non-conformance finding are:

If the evaluator finds a significant number of non-conformances, the Lead evaluator will inform the Manager and discuss the issues. The evaluation may be terminated and the Registered training organisation instructed to take remedial action. Depending on the level of non-compliance, the Certificate of Approval may be suspended for a period of time or withdrawn and reissued as a short-term approval.

Observation

The evaluator is to record  items where they consider a quality system improvement is warranted  but is not a non-conformance as an observation. These are to be mentioned verbally at the closing meeting and are to be formally recorded in the evaluation report.

9. Closing meeting

Following completion of interviews and inspections the evaluators should allow time for discussion and recording of any observation notes or non-conformance findings.

Prior to the closing meeting the Lead evaluator will brief the Manager on the evaluation and identify both positive and negative outcomes.

At the allotted time the closing meeting should take place. Those in attendance should be the AMSA Lead evaluator and evaluators, relevant Registered training organisation staff, including the Head of School (or similar) and the document controller.

The main purpose of the meeting is to report on the results of the evaluation and to discuss all non-conformances and observations recorded during the evaluation.

At the meeting discussion may occur regarding possible rectification action. However all decisions on the method to close out non-conformances are the responsibility of the Registered training organisation.

At the closing meeting the Lead evaluator will thank the Registered training organisation and the staff for their co-operation during the evaluation and reassure them that all information gained from the evaluation will be treated in confidence. If the evaluation is not a certificate renewal evaluation, the Lead evaluator will sign and stamp the Certificate of approval providing the evaluation has been satisfactory.

10. Evaluation report

The Lead evaluator should complete the evaluation report and forward it to the Registered training organisation Head of School (or similar) within one calendar month of completion of the closing meeting.

The report is to address, as a minimum:

The lead evaluationor is also to submit a copy of the evaluation report to the Manager and the other evaluators if applicable and file in HPERM.

11. Evaluation follow-up

If the Registered training organisation has not contacted us and submitted the completed evaluation rectification action plan within the agreed time frame the Lead evaluator will contact the Head of School (or similar) of the Registered training organisation to follow up on the outstanding non-conformance findings;

The lead evaluator will notify the Manager of the situation and continue the follow-up process to achieve a satisfactory outcome;

The follow-up may consist of one or more of the following:

If outstanding non-conformances are not resolved within the agreed time frame, the Manager may withdraw the Certificate of approval from the Registered training organisation or issue a short term Certificate of Approval. The Registered training organisation will be advised of the Manager’s decision.

12. Evaluation records

The Lead evaluator will place the following documents on the appropriate AMSA Registered training organisation HPERM file:

Last updated: 14 November 2023