3.4 Stage 3: Formal External Review (QM Certification Pathway)

What happens: The course is submitted to Quality Matters for formal peer review by trained external reviewers. Reviewers access the course in the institution's LMS and conduct a thorough evaluation using the official QM rubric.

Who is involved:

  • QM staff: Coordinate the review process, manage timelines, and communicate with the institution
  • Two external peer reviewers: Usually subject matter experts and/or experienced online educators from other institutions
  • QM quality assurance team: Validates the review to ensure consistency and rigor

The review process:

  1. Submission: Institution submits the course, course syllabus, and a self-review report to QM
  2. Scoring: Two external reviewers independently score the course using the QM rubric
  3. Comparison and consensus: If the two reviews are similar, a consensus score is created. If scores differ significantly, QM staff review and make a final determination
  4. Feedback report: QM provides the institution with detailed feedback on every criterion (what was done well, what needs improvement)
  5. Certification decision: If the course scores 70 or higher (out of 100), it is certified. If below 70, the institution receives a revision plan and can resubmit after making improvements

Certification outcomes:

  • Certified: Score of 70–100. The course meets QM standards. Institution receives a digital badge and can use "QM Certified" in marketing
  • Certified with Minor Revisions: Score of 70–75. The course is certified but the institution commits to addressing minor issues in the next review cycle
  • Requires Revision: Score below 70. The institution creates a revision plan and resubmits the improved course (typically after 3–6 months)

3.5 The QM Rubric: Scoring and Point Distribution

The QM rubric contains 43 review criteria, each assigned a point value (1, 2, 3, or 4 points) based on impact on learning. A score of 70 out of 100 is the certification threshold. Here's the breakdown:

Standard Number of Criteria Total Points
1. Course Overview and Introduction 6 criteria 15 points
2. Learning Outcomes 6 criteria 16 points
3. Assessment and Measurement of Learning Outcomes 5 criteria 12 points
4. Instructional Materials 5 criteria 10 points
5. Learning Activities and Learner Interaction 5 criteria 10 points
6. Course Technology 5 criteria 12 points
7. Learner Support 3 criteria 9 points
8. Accessibility 2 criteria 6 points
TOTAL 37 criteria 100 points

Note on Scoring

Not all criteria carry equal weight. Criteria that have a greater impact on learning (e.g., alignment between outcomes and assessments) are worth more points. This reflects QM's research-based understanding of what matters most for online learning effectiveness.

Back to 'Unit 3: The QM Review Process\'