Unknowing the Unknown
In 1999, psychologists David Dunning and Justin Kruger at Cornell University published a paper titled "Unskilled and Unaware of It: How Difficulties in Recognizing One's Own Incompetence Lead to Inflated Self-Assessments." The paper described a paradox: people with the least competence in a domain tend to most dramatically overestimate their competence, while genuinely skilled people tend to underestimate theirs.
The studies were straightforward but striking. Participants completed tests in logical reasoning, grammar, and humour and then estimated how well they had performed relative to others. Those who scored in the bottom quartile estimated they had performed around the 62nd percentile — wildly overestimating their relative performance. Those in the top quartile estimated they had performed around the 70th percentile — underestimating their actual standing at roughly the 86th percentile.
The Mechanism: Incompetence Is Self-Concealing
The insight at the heart of the Dunning-Kruger effect is that the skills required to perform a task well are largely the same skills required to evaluate performance on that task. If you lack the competence to do something well, you also lack the competence to recognise that your performance is poor. Incompetence is therefore self-concealing: the person who doesn't know what they don't know cannot perceive the gap.
As Dunning later wrote: "The skills you need to produce a right answer are exactly the skills you need to recognize what a right answer is."
This is distinct from simple overconfidence — it is a specific prediction that people at the bottom of the skill distribution will be the most wildly miscalibrated.
Why Experts Underestimate
The flip side is equally important. Highly skilled people tend to underestimate themselves because they assume tasks they find easy will also be easy for others. They project their competence onto the reference population. This is sometimes called the false consensus effect — assuming that others see things as you do.
For financial education and advice, this has a practical implication: genuine experts often communicate in ways that assume a baseline their audience does not have, underestimating how foreign their knowledge is to a novice.
The Dunning-Kruger Effect in Finance
The financial domain is fertile ground for the Dunning-Kruger effect because it is easy for a beginner to feel competent quickly. Making a few successful trades, reading one or two investing books, or following a market commentary for a few months creates a sense of mastery that outpaces actual skill.
Research by Juhani Linnainmaa (2011) on Finnish investor records found that inexperienced retail investors traded the most actively — consistent with overestimated skill — and achieved the worst returns. The relationship inverted with experience: genuinely skilled investors traded less and earned more.
The curve implied by Dunning and Kruger's work — sometimes illustrated as a "peak of Mount Stupid" (representing peak confidence at low competence) followed by a "valley of despair" (as competence grows and the person recognises how much they don't know) and a final "slope of enlightenment" — maps onto many investors' biographies.