Skip to content
Truth Academy.
Truth Academy
← All modules
Representation & ReasoningCore45 min

Decision Making Under Uncertainty

How to choose well when you can't see the future: the math behind self-driving cars and aircraft collision avoidance.

AI tutor is turned off for this class

Use the CS238 lectures, notes, and assignments below to keep learning.

Big Idea

Representation & Reasoning

Grade bands

K-2 · 3-5 · 6-8 · 9-12

View on the ladder →

Lesson overview

How to choose well when you can't see the future: the math behind self-driving cars and aircraft collision avoidance.

Teacher script · 45 min

  1. 0–5

    Hook

    Should you bring an umbrella? You don't know if it'll rain; you only know a chance. Good decisions aren't about being right every time; they're about being right on average given what you know.

  2. 5–15

    Explore

    Students do the activity in pairs: Use it for real: should you study or sleep before a test you're 70% ready for? Put numbers on it and compute.

  3. 15–30

    Explain

    Real life isn't one choice; it's a sequence, where each move changes what comes next, and sometimes you can't even see the full situation (fog, sensor noise). The trick is to reason backward from good futures to today's best move, and to value information itself, because knowing more changes what you should do.

  4. 30–40

    Connect to the summit

    Read aloud the "From the summit" section below. Ask students which ideas from today they recognize in it.

  5. 40–45

    Check

    Run the formative check below. Anyone who can explain a key term in their own words has it.

Student activity

Use it for real: should you study or sleep before a test you're 70% ready for? Put numbers on it and compute.

Slides

1Title: Decision Making Under Uncertainty
2Hook: Deciding when you're not sure
3Do it: Score your choices
4How it works: Decisions that chain together
5Key idea: Expected value
6Key idea: Utility
7Key idea: POMDP
8From the summit: the Stanford course

Formative check

  • 1.In your own words, what is "Expected value"? (Looking for: The average payoff of a choice, weighing each outcome by how likely it is.)
  • 2.In your own words, what is "Utility"? (Looking for: A number capturing how much you actually value an outcome, not always the dollar amount.)
  • 3.In your own words, what is "POMDP"? (Looking for: A decision problem where you can't directly see the true state, only noisy hints of it.)

Carry-away concepts

Expected value
The average payoff of a choice, weighing each outcome by how likely it is.
Utility
A number capturing how much you actually value an outcome, not always the dollar amount.
POMDP
A decision problem where you can't directly see the true state, only noisy hints of it.
Value of information
How much a decision improves if you go gather one more fact before choosing.

From the summit · the Stanford source

You formalize sequential decisions as POMDPs, solve them with value iteration and online planning, and handle cases where you can't even observe the true state of the world.

This module is based on a Stanford course.