Mission: match my trust in an AI answer to how often it is actually right.
Kahneman's account of overconfidence is that System 1 builds the most coherent story it can from the evidence at hand, and we feel confident in proportion to the coherence, not to the amount of evidence. Calibration is the match between confidence and accuracy. Good calibration means being right about 80 percent of the time when you say 80 percent (see the overconfidence chapters in Part III of the book).
AI can distort calibration in both directions. Long, detailed explanations raise confidence, and so does a smooth, unhedged tone.
In a study of 301 participants, longer, more elaborate AI explanations increased confidence in the answers without improving people's ability to tell correct answers from incorrect ones. Showing uncertainty information raised accuracy without raising confidence, which suggests uncertainty displays can curb overconfidence (arXiv 2603.29681, a preprint, verify before citing). A separate evaluation of interventions found that a reliance disclaimer was the only one that improved appropriate reliance and calibration, and only on one task (To Rely or Not to Rely, arXiv 2412.15584, preprint).
Choose the bias the scenario shows.
Confidence is a feeling produced by coherence. Ask the AI for uncertainty, the assumptions behind its answer, and what would change its mind, then set your trust accordingly.
Try it this week: for three AI answers, write down your confidence from 0 to 100 before checking. Then check and see whether your confidence matched the outcome.