FreeLesson·Behavioural Finance·3 of 5·8 min read·Curated from Daniel Kahneman

Overconfidence — The Most Expensive Bias in Investing

Studies consistently find that 80% of drivers believe they are above-average drivers. Most surgeons believe their complication rates are below average. Most investors believe their stock selection is above average. They cannot all be right. The gap between perceived skill and actual skill — overconfidence — is the most consistently documented and most costly bias in financial markets.

Why This Matters

Overconfidence bias is not simply arrogance. It is a systematic miscalibration — a consistent tendency to hold beliefs with greater certainty than the evidence warrants, to assign too-narrow confidence intervals to uncertain outcomes, and to overestimate the accuracy of one's own analysis. Research by Kahneman and others has documented overconfidence across virtually every domain that involves judgment under uncertainty. Experts are not exempt — in some studies, experts are more overconfident than novices because they have a more elaborate narrative to support their certainty. Financial markets are particularly vulnerable because they provide just enough feedback to feel informative while being complex enough to prevent genuine calibration.

The Core Idea

Overconfidence manifests in three specific and destructive investment patterns. The first is overtrading. Terrance Odean's landmark study of individual investor trading records found that the stocks investors sold outperformed the stocks they bought by 3.4 percentage points per year after transaction costs. The active trading that investors engaged in — driven by the confidence that they knew which stocks would outperform — consistently destroyed value. The best investor behaviour, on average, would have been to do nothing. Yet overconfidence convinced investors they had an edge that justified the friction costs of trading. The second manifestation is under-diversification. Investors who are confident in their own stock selection tend to concentrate portfolios in a small number of positions they "know." For genuinely skilled analysts with genuine information advantages in specific companies, this concentration can be justified. For the vast majority of investors — whose stock selection adds no reliable predictive value beyond chance — concentration simply amplifies idiosyncratic risk without compensating upside. The confidence that drives concentration is almost never matched by the skill that would justify it. The third manifestation is the planning fallacy — consistently underestimating how long projects take, how much they cost, and how many things will go wrong. Applied to investment theses, the planning fallacy causes analysts to build financial models with optimistic assumptions that are rarely questioned, management timelines that are rarely met, and competitive dynamics that rarely develop as predicted. The confidence of the model obscures the uncertainty of the inputs.

Daniel Kahneman's Perspective

Kahneman on the planning fallacy: "The problem with experts is not that they know too little — it is that they know too much about why their specific situation is different from the base rate. The outside view — what is the average outcome for projects like this?

is systematically more accurate than the inside view — what do I know about the specific details of this project that makes it likely to succeed? The experts who produce the most accurate forecasts are those who check their inside-view models against outside-view base rates."

A Real Example

Real-World Example

Long-Term Capital Management is the most dramatic institutional case study in investment overconfidence. LTCM's principals — including two Nobel laureates in economics — built models of extraordinary sophistication and genuinely deep quantitative insight. Their confidence in those models was near-absolute. When market conditions in 1998 deviated from the models' assumptions, their response was to add to positions rather than reduce risk — confidence in the model overriding the market's feedback. The fund collapsed, losing nearly all its capital and requiring a Federal Reserve-coordinated bailout. No analytical failure caused this — it was the failure to hold the model with appropriate humility relative to the uncertainty of the real world.

The Common Mistake

The most common mistake is treating confidence as evidence. Investors who feel certain about a thesis often interpret that feeling as a sign that the analysis is correct. In fact, the feeling of certainty is generated by System 1 — the fast, pattern-recognising system — and is almost entirely unrelated to the actual accuracy of the underlying analysis. The discipline of "confidence calibration" — asking "how often have I been this confident, and how often have I been right?" — is a more reliable guide than the feeling of certainty itself.

Key Takeaways

    What to Read Next

    The next lesson explores Herding and Social Proof — the systematic tendency for investors to follow the crowd, why it is psychologically compelling, and how the greatest investment opportunities arise precisely when rational investors are willing to stand apart from consensus.

    Continue →

    Herding — Why Smart People Follow the Crowd Off the Cliff