Substitution and "what you see is all there is"

Lesson 9 · Thinking Fast and Slow × AI · about 10 minutes

Mission: notice when an AI answers an easier question than mine, or answers from incomplete information.

The core idea

Substitution is when we answer an easier question than the one asked, without noticing the swap. Kahneman's example is judging a complex matter by a simpler feeling about it. WYSIATI, "what you see is all there is," describes how System 1 builds a judgment from the information in front of it and gives little weight to what is missing (see the Part II discussion of WYSIATI in the book).

AI models answer from the prompt and context they receive. If important information is missing, the answer can still look complete, and you may accept it because nothing looks absent. A narrow question can also be answered well while the question that matters goes unanswered.

Practice

Choose the bias the scenario shows.

1. You ask, "Should we hire this vendor?" The AI answers only about price, which is the easiest part to assess.
Correct. The harder question was about risk, and the AI answered the easier one about price.
Not quite. The answer addressed a simpler question than the one you asked. That is substitution.
2. Your prompt omits the vendor's data retention terms. The AI's recommendation sounds thorough, and you accept it without asking what is missing.
Correct. The answer felt complete because it only used what was in the prompt.
Not quite. The answer felt complete only because the missing data never came up. That is WYSIATI.
3. Before asking for a recommendation, what step counters WYSIATI most directly?
Correct. Naming the gaps first makes the missing information visible before you rely on the answer.
Not quite. The fix is to make the gaps visible before the answer is formed.

Takeaway

Before accepting an AI answer, restate the question you actually need answered, and list the information the answer would need that is not in the prompt. If the answer changes when you add it, the first answer was about a different question.

Try it this week: take one recommendation you requested. Add the three facts you left out, and ask again. Note what changed.

Sources

Questions? Stuck on any idea? Ask your teacher in this conversation. Previous: Lesson 0008. Next: Lesson 0010, capstone.
← Previous Next →