Thursday, February 26, 2009

Mediocrity and Genius

Mediocrity knows nothing higher than itself, but talent instantly recognizes genius.

-- Sir Arthur Conan Doyle, (Sherlock Holmes) Valley of Fear, 1915
What Doyle noted nearly a century ago is now known as the Dunning-Kruger effect. It shows that people who are incompetent in areas as widespread as humor, grammar and logic are often blissfully unaware of their own shortcomings. It also shows that incompetent people are often unable to recognize genuine competence in others.

I've talked before about second-order incompetence, and about how it relates to programming. Conventional wisdom among programmers seems to be that being aware of your own shortcomings is really a sign of competence. Knowing that there are things you don't know is a sign of a wise and experienced developer.

This isn't far off the mark, but according to follow-up studies by Dunning and Kruger, it's only a first small step. The skills required for competence in a particular area are the same skills necessary to recognize competence in yourself and in others. It still takes concentrated study in that area in order to raise your competence to the level necessary to be a good judge.


Rob said...

I commented a bit on this very topic last Summer after reading a somewhat-enraging diatribe from Steve Yegge.

You can find my post here.

Bill the Lizard said...

Thanks for the link to your post. I think it's a positive sign that you're introspective enough to turn the Dunning-Kruger microscope around and use it to evaluate yourself. Most people I explain it to don't immediately take that step. It's fun to apply it to others. It can be scary (but so rewarding) to apply it to yourself.