Program 01 · AI governance (AIGP)

What AI is, and why it needs governing

12 min read

The exam uses the OECD definition, which the EU AI Act also builds on: an AI system is a machine-based system that, for explicit or implicit objectives, infers from the input it receives how to generate outputs such as predictions, content, recommendations or decisions that can influence physical or virtual environments. Systems vary in autonomy and in how much they adapt after deployment.

The key word is infers. Traditional software follows rules a programmer wrote. Machine learning (ML) learns patterns from data, so its behavior depends on that data and its outputs are probabilistic.

Types you must recognize

TypeWhat it doesExample
Rules-based / symbolicFollows hand-written logicExpert system for tax rules
Supervised learningLearns from labeled examplesFraud classifier trained on labeled transactions
Unsupervised learningFinds structure in unlabeled dataCustomer segmentation by clustering
Reinforcement learningLearns by reward and penaltyRobot control, game playing
Deep learningMany-layered neural networksImage recognition, speech
Generative AI / foundation modelsProduces new content; trained on broad data and adaptableLarge language models, image generators
Agentic AIPlans and takes actions with tools toward a goalAn assistant that books travel

Also know narrow AI (one task, which is everything in production today) versus general AI (hypothetical human-level breadth).

Why AI is "socio-technical"

AI risk does not live in the model alone. It comes from the model plus its data, the people who build and use it, and the context it is deployed in. The same face-matching model is low risk unlocking a phone and high risk identifying protest attendees. Expect exam answers that fix a problem through people and process, not only through code.

What makes AI different to govern

  • Opacity: complex models are hard to explain.
  • Scale and speed: one flawed model can affect millions of decisions.
  • Data dependence: bias and errors in data become bias and errors in outputs.
  • Probabilistic outputs: the system will be wrong some of the time, by design.
  • Change over time: performance drifts as the world changes.
  • Autonomy and emergent behavior: especially in generative and agentic systems.

Check your understanding

Check 1 of 2Domain I. Foundations

Which word in the OECD definition best separates AI from conventional software?

Check 2 of 2Domain I. Foundations

A bank's model learns to flag fraud from millions of transactions already labeled 'fraud' or 'legitimate'. This is:

Answer the checks, then mark this lesson complete
Completion and scores are saved in this browser.
Next: The AI lifecycle →