Thing of Things
Sign in
  • About
  • Archive
  • Help
  • Sign in
Share this post
Knightian Uncertainty
thingofthings.substack.com

Knightian Uncertainty

Some kinds of not knowing

Ozy Brennan
Nov 30, 2021
11
Comment3Share
Dice tumbling.

Nearly everyone is uncertain about some things [citation needed]. For example, you might be uncertain whether the Qin dynasty occurred before the Ming dynasty, what exactly it means that E equals M C squared, whether the coin you just flipped is going to come up heads, when the next book in A Song of Ice And Fire is going to come out, or what dark matter is.

When we talk about uncertainty, it’s important to distinguish two kinds of uncertainty. These are sometimes called risk and Knightian uncertainty, but “risk” is kind of a confusing word for it so I’m going to call them regular uncertainty and Knightian uncertainty.

Regular uncertainty is uncertainty where you understand what you’re uncertain about. For example, think about the coin flip. You’re uncertain whether the coin is going to come up heads or tails. But you’re nearly one hundred percent confident that the coin is going to come up heads or tails. In fact, you know that it’s fifty percent likely that the coin comes up heads and fifty percent likely that the coin comes up tails (weighted coins aren’t physically possible).

Knightian uncertainty where you don’t understand what you’re uncertain about. Think about debates about consciousness. You can see that questions like “what is consciousness? how can we tell whether a being is conscious?” are very different from questions about coin flips. You can’t say “well, there’s a fifty percent chance that dogs are conscious” with the same certainty that you say “well, there’s a fifty percent chance that the coin flip will come up heads.” If asked to give a probability, you’ll probably hem and haw and eventually give a number that feels kind of arbitrary. You don’t know whether your concepts or your approach to the problem are even sort of heading in the right direction. You don’t know what all the possible answers even look like: maybe the true definition of consciousness is something we haven’t even thought of.

Of course, in the real world, it’s very rare to have a situation that only has regular uncertainty or only has Knightian uncertainty. When you’re planning your wedding, you mostly have regular uncertainty about whether the caterers will show up on time. But you have some Knightian uncertainty: maybe there was a horrible miscommunication with the caterers because of an expectation you had no idea about because you’ve never planned a wedding before. Conversely, if you’re treating an undiagnosed chronic illness, you have some regular uncertainty: you might know about forty percent of your days are bad, so you can wake up in the morning expecting a forty percent chance that today is bad. But most of your uncertainty is Knightian: you don’t know whether this medication will work, or what factors imply that this medication will or won’t work, or what your diagnosis is, or whether your diagnosis is even known to medical science.

Why is this distinction important? Because we should think about situations with a lot of Knightian uncertainty differently from situations with a lot of regular uncertainty. Just as one example, in a situation with a lot of Knightian uncertainty, you’re likely to be blindsided by something you totally didn’t think about or that wasn’t even possible in your best understanding of the world. So if you’re in a situation with a lot of Knightian uncertainty, you might want to:

  • Take actions that are probably good even if you’re wrong about everything (e.g. if you’re chronically ill trying to get enough sleep might help and probably won’t hurt).

  • Take actions that make you or other people more likely to notice if you’re wrong (e.g. telling the truth, pointing out flaws in your own arguments).

  • Be ready to deal with unexpected bad things (e.g. saving up money, having a first aid kit).

  • Think about things and learn so that more of your uncertainty is regular uncertainty (e.g. talk to someone who’s planned a wedding before about how caterers work).

11
Comment3ShareShare

Create your profile

Only paid subscribers can comment on this post

Already a paid subscriber? Log in

Check your email

For your security, we need to re-authenticate you.

Click the link we sent to , or click here to log in.

Reggie Reagan
Jan 10

I think a key thing about Knightian uncertainty is that we don't necessarily expect the laws of probability to apply to them.

One law of probability is Bayes' theorem; I don't really know what not following Bayes' theorem looks like.

Another is, if A implies B, then

P(A) ≤ P(B)

The "conjunction fallacy" is violation of the special case where A is "B&C". For example, B = "Linda is a bank teller" and A is "Linda is a feminist bank teller".

nostalgebraist talks about this in his old Bayes masterpost, section 7: https://nostalgebraist.tumblr.com/post/161645122124/bayes-a-kinda-sorta-masterpost

He points out that such logical relations are often unknown, and therefore we cannot always follow this law of probability theory.

Expand full comment
Reply
Vanessa
Dec 1, 2021

Btw in decision theory, the formal treatment of Knightian uncertainty is known as "imprecise probability" and there are various different approaches (Dempster-Shafer theory, credal sets, previsions etc). And ofc the topic is close to my heart since a lot of my recent work is applying this to AI theory :)

Expand full comment
4
Reply
1 more comments…
TopNewCommunityWhat is Thing of Things?AboutAbout

No posts

Ready for more?

© 2022 Thing of Things. See privacy, terms and information collection notice
Publish on Substack
Thing of Things is on Substack – the place for independent writing