Quick answer

An AI risk matrix rates each identified risk by likelihood and severity (impact), often on 1–5 scales, and multiplies or plots them to set a risk level that drives treatment. Key points for the AIGP: assess inherent risk (before controls) and residual risk (after controls); severity weighs harm to individuals and society, not just the organisation; and the risk level should guide human oversight (in, on or out of the loop) and approval levels. The exam tests the reasoning, not arithmetic.

Risk matrices appear throughout AI governance: impact assessments, NIST AI RMF practices, ISO/IEC 42001 risk treatment and Singapore's human-involvement model. AIGP questions use them to test whether you can reason about risk. Here's how they work.

A basic AI risk matrix

Likelihood ↓ / Severity →1 Minimal2 Minor3 Moderate4 Major5 Severe
5 Almost certain510152025
4 Likely48121620
3 Possible3691215
2 Unlikely246810
1 Rare12345

Typical bands: 1–4 low, 5–9 medium, 10–16 high, 20–25 critical. Organisations set their own scales and bands.

What's different about AI risk

  • Severity includes harms to people and society: discrimination, loss of access to services, safety, and fundamental rights. Not just financial or reputational impact on the organisation.
  • Scale matters: an AI error repeated across thousands of decisions can turn a minor individual harm into a major aggregate one.
  • Reversibility: harms that can't easily be undone, such as a wrongful denial of benefits, rate higher on severity.
  • Likelihood changes over time: drift, new users and model updates mean you need to reassess.
  • Opacity: if failures are hard to detect, the effective likelihood of harm goes up.

Inherent vs residual risk

Inherent risk is the level before controls. Residual risk is the level after controls such as human review, testing, guardrails and monitoring. Governance decisions, such as whether to deploy and who approves, should be based on residual risk compared against your risk appetite. Document both.

From risk level to human oversight

Singapore's Model AI Governance Framework links the probability and severity of harm to the degree of human involvement:

Risk profileOversight modelExample
High severity, high probabilityHuman-in-the-loop (a human makes the decision)Medical diagnosis support
Severe if it happens, low probability; or moderateHuman-over-the-loop (a human monitors and can intervene)Fraud alerts with analyst review
Low severity, low probabilityHuman-out-of-the-loopProduct recommendations

See Singapore's framework vs NIST.

Worked example

A bank plans an AI model that recommends whether to approve small-business loans.

  1. Risk: the model systematically under-approves applicants from certain postcodes, which act as a proxy for ethnicity.
  2. Inherent rating: likelihood 3 (possible, because historical data reflects past lending bias) × severity 5 (discrimination; denial of access to credit; regulatory exposure) = 15, high.
  3. Controls: remove or test proxy features, run fairness testing before release, require human review of declines, monitor approval rates by group monthly, and give applicants a route to explanation and appeal.
  4. Residual rating: likelihood 2 × severity 4 = 8, medium.
  5. Decision: approve deployment at the committee level, with quarterly reassessment. Also note that AI credit scoring is high-risk under the EU AI Act, with a FRIA required from 2 December 2027.
Exam traps: (1) rating severity only by cost to the organisation; (2) treating a high inherent score as an automatic ban instead of a trigger for controls; (3) forgetting to reassess after changes; (4) assuming human oversight lowers risk when reviewers just rubber-stamp outputs (automation bias).

Factors that raise AI likelihood and severity

Raises likelihoodRaises severity
Training data unrepresentative of the people the system servesDecisions affecting access to jobs, credit, housing, healthcare or benefits
Little testing on real-world conditions or subgroupsHarm to vulnerable groups (children, patients, people in financial difficulty)
High autonomy and no human reviewHarms that are hard to reverse or detect
Frequent model or data changesLarge numbers of people affected
Exposure to untrusted inputs (prompt injection, poisoned data)Safety, legal or fundamental rights consequences
Third-party models with limited transparencyReputational or regulatory exposure for the organisation

Linking risk scores to governance actions

Residual riskApprovalRequired controlsReview cycle
LowUse-case owner, with a checklistBasic documentation, standard monitoringAnnual
MediumAI governance teamImpact assessment, testing evidence, user transparencySix-monthly
HighAI governance committeeFull assessment, bias and robustness testing, human oversight design, incident planQuarterly or on change
UnacceptableRejected, or executive decision with strong justificationRedesign or stop–

The AIGP rewards answers that tie the level of oversight and documentation to the level of risk. A one-size-fits-all process is usually the wrong answer.

Legal categories override scores

A matrix is an internal tool. It doesn't change legal classifications:

  • A prohibited practice under Article 5 of the EU AI Act is prohibited however low your score.
  • An Annex III system is high-risk under the AI Act unless the Article 6(3) filter applies, whatever your internal rating.
  • A DPIA is required where GDPR Article 35 says so, even if your AI score is medium.

Good practice is to apply legal classifications first, then use the matrix to set controls within each category.

Common mistakes with AI risk matrices

  1. Scoring the model in the abstract rather than a specific use in a specific context.
  2. Ignoring who is affected and how vulnerable they are.
  3. Treating "we have a human in the loop" as an automatic low score without checking the oversight is meaningful.
  4. Never re-scoring after model updates, new data or new uses.
  5. Adding up scores across very different harms, which hides the worst one.

Sample AIGP-style question (original Archuz item)

An AI system has a low likelihood of error, but an error would cause severe, irreversible harm to individuals. Which oversight approach is most appropriate?

  1. Human-out-of-the-loop, because errors are unlikely
  2. Human-in-the-loop or human-over-the-loop with strong intervention capability, because severity is high
  3. No oversight, but extensive logging
  4. Annual audits only

Answer: B. Severity, especially irreversibility, justifies meaningful human involvement even when likelihood is low.

Risk reasoning, practised

The AIGP Complete Pack includes risk-assessment and oversight scenarios across its 300 BoK v2.1 questions.

Get the Complete Pack →

Frequently asked questions

How do you calculate an AI risk score?

Commonly, by multiplying likelihood by severity on defined scales (for example 1–5 each), then mapping the result to risk bands that drive treatment.

What is residual risk in AI governance?

The risk that remains after controls are applied. Deployment decisions should be based on residual risk against your risk appetite.

Will the AIGP ask me to calculate risk scores?

Questions focus on reasoning, such as what drives severity, how controls change residual risk, and which oversight fits, rather than arithmetic.

Does an internal AI risk score override the EU AI Act?

No. Legal classifications such as prohibited practices and Annex III high-risk uses apply regardless of internal scores. Use the matrix to set controls within those legal categories.

How often should AI risk scores be reviewed?

On a schedule matched to the risk, for example annually for low risk and quarterly for high risk, and whenever the model, data, use or affected population changes.

Sources

  1. PDPC Singapore: Model AI Governance Framework
  2. NIST AI RMF
  3. ISO/IEC 23894: AI risk management guidance

Last reviewed: October 2026.