Bayes' Theorem Basics: Updating Probability With New Evidence

Click through each step to understand the basics.

  1. What Is Bayes' Theorem?

    Bayes' theorem is a method for recalculating the probability of an event more accurately whenever new information or evidence becomes available.

  2. What Is Prior Probability?

    Prior probability is the initial probability estimate held before new information is obtained β€” the base rate of a disease in the general population is an example of a prior probability.

  3. What Is Posterior Probability?

    Posterior probability is the updated probability after new information is factored in β€” the recalculated probability of having a disease after receiving a test result is a posterior probability.

  4. The Trap in Interpreting Medical Test Results

    Even a test that's 99% accurate for a very rare disease can produce a positive result where the actual probability of having the disease is, counterintuitively, still low β€” because the disease itself was so rare to begin with.

  5. The Error of Ignoring the Base Rate

    Looking only at a test's accuracy while ignoring the base rate β€” how rare the event actually is to begin with β€” easily leads to overconfident, mistaken conclusions.

  6. How Spam Filters Use It

    Spam filters continuously update the probability that an email containing certain words is spam, based on past data, becoming more and more accurate at filtering spam over time.

  7. Bayesian Thinking in Everyday Life

    The habit of slightly revising an existing belief each time new information arrives is, in essence, the core principle of Bayes' theorem applied to everyday thinking.

Probability Isn't a Fixed Value

When new evidence or information becomes available, our judgment about the probability of an event should update along with it. Bayes' theorem provides a systematic way to calculate this process of updating probability, and it's used widely, from medical diagnosis to spam email filtering.

It Helps to Know the Basics of Probability First

Understanding Bayes' theorem is easier with a grasp of basic probability concepts first, which makes a natural companion topic to this one.

Frequently Asked Questions

Is Bayes' theorem a difficult concept only experts use?

The formula itself can look complex, but the core principle β€” revising an existing judgment based on new information β€” is a way of thinking commonly used in everyday decision-making too.

If a test result comes back positive, does that mean I have the disease?

Not necessarily β€” the actual probability depends heavily not just on the test's accuracy but also on how common the disease is to begin with (the base rate), so it's safer to confirm with additional testing or a specialist's opinion.