I like to use probabilities to give investors a sense of what might happen in the future. For example, I might tell them there's a 50% chance that if they deploy a particular investment strategy they'll have at least $1 million in 20 years and a 20% chance they'll have at least $3 million, but a 2% chance they'll have no more than $500,000.
Two questions must be asked: First, what model should be used to estimate those probabilities? And second, do people understand what they mean?
Blogger Michael Graham Richard hosts an interesting discussion of how these two questions relate to each other. It's often thought that people (read, "laymen") overestimate probabilities of unlikely events. Experts, on the other hand, can calculate them objectively. For example, experts calculate probabilities of nuclear power accidents by tracing through every possible event tree, estimating its small probability and adding these small probabilities together. Laymen, on the other hand, see how many things can go wrong, and panic, overestimating the resulting probability.
Who's right, the experts or the laymen? Nuclear power risks are totally different from investing risks. But in investing, we have clearly seen that the experts get it wrong, time and time again. How often have we heard that an "expert" said, "This event [which actually happened] had only a one-in-a-trillion chance of occurring"?
The problem is that "experts" depend only on "objective" information -- that is, on a limited quantity of historical data. This includes -- to use Donald Rumsfeld's famous formulation -- only the "known unknowns" (or at least the known level of uncertainty found in relatively recent history), but not the "unknown unknowns", that is, the uncertainties that cannot be calculated from recent history.
So in investing -- if not necessarily in nuclear power -- experts' estimates of risks need to be almost totally ignored, because their methodology is fatally flawed.
That said, I do believe that probabilities of investment results can be estimated realistically, but certainly not by using the methods that experts have been using.