I mentioned Scout Mindset, the new book by Julia Galef, just the other day. Now I am two
thirds through the audio book, read by herself, and can wholeheartedly recommend it once more. It is quite close to
what I expected from it.
One chapter is about calibrating beliefs, that is not only being aware of what you belive to be right, but also
how confident you are about that, by assigning a probability to beliefs being correct. Then, in her own words:
Being perfectly calibrated would mean that your “50% sure” claims are in fact
correct 50 percent of the time, your “60% sure” claims are correct 60 percent
of the time, your “70% sure” claims are correct 70 percent of the time, and
so on. Perfect calibration is an abstract ideal, not something that’s
possible to achieve in reality. Still, it’s a useful benchmark against which
to compare yourself.
She then provides opportunity to practice by
answering trivia questions. This was more fun than I expected and you should click
there right now and spend a few minutes on this!
I say this not only because it just so happened that I did well this time: My
guesses about which I was 55%, 65%, 75%, 85% and 95% certain, turned out to
be 50%, 67%, 80%, 100% and 100% correct, respectively. Probably a fluke.
Full score sheet.