The OCQAS provides clear, comprehensive, and publicly accessible descriptions of the evaluation procedures used in both the College Quality Assurance Audit Process (CQAAP) and the Credential Validation Service (CVS).

For CQAAP, these procedures are documented in several publicly available resources, including:

• CQAAP-Standards and requirements
• CQAAP Guidelines and Framework
• Audit Evaluation Framework Policy 10
• Quality Assurance Audit Policy 18
• Quality Assurance Audit Procedure 18-1

Together, these documents clearly explain the evaluation procedures and the basis for decision making. The CQAAP Standards and requirements establish the criteria against which institutional quality assurance mechanisms are assessed. The Audit Evaluation Framework Policy describes how these criteria are applied to determine the maturity level of institutional quality assurance systems. The Quality Assurance Audit Policy and Procedure define the roles and responsibilities of all parties involved in the evaluation process, including the OCQAS’ staff, audit panel members, and participating colleges.

The CQAAP Guidelines and Framework integrates these elements by outlining the timelines, stages, and standardized procedures that guide the audit process, ensuring that evaluation decisions are evidence-based and conducted consistently across institutions.

For CVS, these procedures are documented in several publicly available resources, including:

• Minister’s Binding Policy Directives (MBPD)
• Ontario Qualifications Framework
• Framework for Validation of Programs Policy 13
• CVS Credential Validation Guidelines

These documents collectively establish the criteria, expectations, and procedural steps used to assess program proposals. They ensure that institutions understand the information required, how assessments are conducted, and the basis upon which decisions are made.

CVS employs a structured, iterative, and evidence-based desk-review process. Each program submission is reviewed against the established criteria, typically through multiple stages of feedback between OCQAS and the submitting college. On average, three review cycles occur, though additional iterations may be required to ensure alignment with Ministry requirements and quality expectations. (CVS Program Review-Comments, CVS Title Modification – Comments Resolved, Feedback on CVS submission in the tool).

The decision outcomes of the CVS validation process are clearly defined as follows:

• Validated: the program meets all requirements of the OQF and Ministry directives.
• Not Ready for Validation: the program does not yet meet requirements; detailed feedback is provided outlining required revisions.

When a program is not ready for validation, CVS provides comprehensive, structured feedback, including comments and recommendations, to support improvement. This includes formal feedback through the CVS automated assessment tool and informal feedback during pre-submission or iterative review stages.

This developmental approach ensures that institutions are supported in achieving compliance, while maintaining the integrity and consistency of validation decisions. CVS works collaboratively with colleges throughout the process to refine proposals until they meet the established standards, thereby ensuring fairness, transparency, and consistency in decision-making.

The OCQAS ensures consistency, fairness, and impartiality across all external quality assurance activities through a comprehensive set of controls embedded in both the College Quality Assurance Audit Process (CQAAP) and the Credential Validation Service (CVS). These controls include standardized assessment procedures, clearly defined criteria, transparent decision-making processes, internal moderation mechanisms, reviewer training, conflict of interest safeguards, and formal appeal mechanisms.

CQAAP

Standardized Assessment Procedures

The CQAAP Guidelines and Framework (2025–2026) establishes standardized procedures for all stages of the audit process. These include requirements for evidence submission, protocols for audit visits, structured interview formats, report templates, and defined timelines. By using a consistent process across all audits, the OCQAS ensures that institutions are evaluated through the same procedures and expectations.

Clear Assessment Criteria

Assessment criteria are explicitly defined within:

• • the CQAAP-Standards and requirements, which set out the expectations against which colleges’ internal quality assurance mechanisms are evaluated. Each Standard identifies the area of quality assurance under review, while the associated Requirements establish a specific element being assessed.
  • Audit Evaluation Framework Policy 10, which explains the criteria used to determine the different decisions, for requirements, Standards and maturity results.

Transparent Decision-Making Procedures

Transparency in decision-making is supported through clearly documented procedures and public reporting. The Quality Assurance Audit Procedure 18-1 outlines the roles and responsibilities of the audit panel, and the Management Board during the decision-making process. Following the completion of each audit, executive summaries and final audit decisions are publicly available on the OCQAS website.

Internal Moderation Processes

The OCQAS applies several internal moderation mechanisms to ensure that evaluation findings remain consistent across institutions. These include the participation of the OCQAS staff in all audit visits to provide procedural guidance and ensure the consistent application of the Standards and Requirements across the 24 colleges. Draft audit reports are also internally reviewed to ensure consistency in structure, clarity of findings, and sufficient evidence to support evaluation decisions. Finally, the OCQAS Management Board conducts a formal review of audit reports to verify that conclusions align with the established criteria (Management Board Review of CQAAP Reports), reflect system-wide expectations, and are applied consistently across audits.

Training Programs for Reviewers and OCQAS Staff

All audit panel members participate in an orientation (Auditor Information Session) prior to conducting reviews. This training covers evaluation procedures, the triangulation of evidence, and expectations regarding professional conduct and impartiality.

In addition, a mandatory training (CQAAP Guidelines and Framework, pp.15-17) session is held for each audit. This session supports the calibration of reviewer judgments, reinforces a shared understanding of the Standards and Requirements, and promotes the consistent application of evaluation criteria across review teams.

To ensure appropriate experience and leadership within review panels, audit panel chairs are appointed from the existing pool of auditors. Individuals must first participate in audits as panel members and subsequently serve as co-chairs before being appointed as panel chairs, ensuring they have developed sufficient experience with the evaluation process, standards, and reporting expectations.

Similarly, the OCQAS staff undergo a period of shadowing, working alongside an experienced OCQAS staff member before independently coordinating an audit, ensuring familiarity with procedures and consistent application of the audit process.

Conflict of Interest Policies

The OCQAS maintains a Conflict of Interest Policy 07 that applies to reviewers, audit panel members, OCQAS staff, and consultants as well as a procedure that applies directly to the Management Board . These documents require disclosure of any real or perceived conflicts and mandate recusal where appropriate, ensuring impartiality in all evaluation activities.

Appeals Procedures

The OCQAS maintains a formal CQAAP Appeals Policy 08 that provides institutions with the opportunity to challenge decisions under defined circumstances. The policy specifies the grounds for appeal, submission timelines, review procedures, and communication of outcomes, ensuring fairness and procedural transparency.

CVS

Standardized Assessment Procedures

The Credential Validation Service (CVS) follows standardized validation procedures defined in the CVS Credential Validation Guidelines and supported by standardized templates and validation tools. These procedures guide the submission and review of program proposals and ensure that all program validations follow the same structured process.

Clear Assessment Criteria

CVS validation criteria are clearly articulated in the Minister’s Binding Policy Directive – Framework for Programs of Instruction and the Minister’s Binding Policy Directive – Admissions Criteria, which complement the Ontario Qualifications Framework (OQF) and its associated guidance materials. These criteria establish expectations regarding credential levels, program titles, vocational learning outcomes, program advisory committees, and Board oversight. Colleges must demonstrate alignment with these requirements for programs to be validated.

Transparent Decision-Making Procedures

Transparency in decision-making is supported through a clearly documented policy and public reporting. The Framework for Validation of Programs Policy 13 outlines the requirements and processes for program validation, as well as the roles and responsibilities of the OCQAS and the liaison with the colleges and with the Ministry of Colleges Universities Research Excellence and Securities (MCURES) during the decision-making process.

The CVS validation decisions are made through the OCQAS’s established review procedures without the involvement of the OCQAS Management Board. All validation outcomes are recorded and reported to the Ministry, which retains responsibility for decisions related to program funding.

Transparency is further reinforced through direct communication of validation outcomes to colleges and through regular reporting on CVS activity. For example, CVS Annual Reports summarize validation outcomes and sector trends, providing the college system with visibility into validation activity and decision-making outcomes.

Internal Moderation Processes

Internal moderation is ensured through a double-review procedure for all program submissions. Each submission is independently reviewed by the two OCQAS staff to verify alignment with the validation criteria. The OCQAS Staff consult and reconcile their assessments to ensure that the validation criteria have been applied consistently. This process strengthens the reliability of CVS decisions and ensures that validation outcomes are based on consistent and evidence-based application of the established criteria before decisions are communicated to colleges.

Training Programs for People Reviewing CVS Submissions

All individuals involved in reviewing CVS submissions, the OCQAS staff and occasional secondees, complete a period of shadowing with the Executive Director and/or the Quality Assurance Manager before conducting reviews. This onboarding process ensures that reviewers are familiar with CVS procedures, understand the validation criteria, and apply them consistently in their assessments. The review of CVS submissions is conducted almost entirely by the OCQAS staff, with occasional support from secondees. The validation decision remains with the OCQAS staff.

The CVS Manual and Guidelines for Staff and Secondees provides detailed operational guidance for conducting program validations. It outlines key review considerations, validation procedures, and standard approaches to assessing submissions, as well as steps for documenting and communicating validation decisions. The manual also includes standardized templates and guidance used by reviewers to ensure consistent evaluation practices and clear communication of validation outcomes to colleges.

Conflict of Interest Policies

The OCQAS maintains a Conflict of Interest Policy 07 that applies to reviewers,  the OCQAS staff, and consultants. This document requires disclosure of any real or perceived conflicts and mandates recusal where appropriate, ensuring impartiality in all validation activities.

Appeals and Complaints Procedures

The OCQAS maintains formal mechanisms for addressing concerns related to CVS activities through the Framework for Validation of Programs Policy 13. The policy outlines the process through which colleges may appeal title and program validation decisions. Colleges are first encouraged to bring concerns to the attention of the Executive Director. If the matter is not satisfactorily resolved, the concern may be escalated to the OCQAS Management Board Chair or another member of the OCQAS Management Board.

These procedures provide an additional safeguard to ensure fairness, accountability, and transparency in CVS validation outcomes.

 

In summary, these mechanisms collectively ensure fair, impartial, and evidence-based judgments across all external quality assurance processes.