I pick two numbers, randomly, and tell you one of them.
decision/high.or.low Added material
Problem
I pick two numbers, randomly, and tell you one of them. You are supposed to guess whether this is the lower or higher one of the two numbers I picked. Can you come up with a method of guessing that does better than picking the response "low" or "high" randomly (i.e. probability to guess right > .5) ?
Show solution
Pick any cumulative probability function P(x) such that a > b ==> P(a) > P(b). Now if the number shown is y, guess "low" with probability P(y) and "high" with probability 1-P(y). This strategy yields a probability of > 1/2 of winning since the probability of being correct is 1/2*( (1-P(a)) + P(b) ) = 1/2 + (P(b)-P(a)), which is > 1/2 by assumption.
Additional material
[ Editor: Barry Merriman's summary of the replies to his posting of
this game, with an intuitive explanation of why the strategy works. ]
Thanks to everyone who sent comments on my weird game. With your help,
I have pieced together a simple, intuitive understanding of why the
strange strategy works. I think even the people who _can't_ do the
three card Monte problem can understand this :-)
Follow me through my explanation; once you understand the principle,
its fun and easy to create your own probability "paradoxes". As an
example, I create one that is simpler than my original "game".
Recall the game: the dealer has put two real numbers, (U, L with L < U)
in a hat. You draw one number from the hat---call it x. You then have
to guess whether x = L or x = U.
[Reminder: You know _absolutely nothing_ about how U, L were chosen: you
don't know their magnitudes, signs, or whether they were chosen
randomly, or whether they were just the ages of the dealer's parents in
minutes, etc. U, L simply exist, with no assumption about how they were
chosen. ]
The winning strategy was to pick a random number y according to some
probability density p(y) (e.g. Gaussian), and pretend that the number
left in the hat was y, and guess accordingly. (see original post for
precise details...its a little more complicated, or see the simplified
version later on in this post.) The mathematics shows that this does
increase your chances of guessing correctly to beyond 50%. In fact,
your odds are (1/2)*( 1 + P[ L < y < U ])
The amazing thing is that it seems like your odds in the game as stated
should be limited to 50-50. Since the mathematics is correct, we need
to beef up our intuition. The key questions:
Q1 "Why can my odds exceed 50%?"
Q2 "What am I really doing by using this prob. density mumbo-jumbo,
and why does my advantage depend on P[L < y < U]?"
Q3 "How can I see simply what my odds are?"
Q4 "What have we learned from this "paradox"?" <---most important
The Answers:
To get us in a good position to see whats going on, consider this
simpler strategy first:
Simple Strategy:
idea: Pretend that zero lies between L and U, i.e. pretend the picture
is:
<-------*----0--------*---->
L U
and guess accordingly.
As a strategy, this means
(a) If I draw x > 0, I guess x = U
(b) If I draw x < 0, I guess x = L
This is a well defined strategy (even though the idea that led to it
may be false.)
result:
(1) If 0 is between U, L I guess correctly 100% of the time.
(2) If 0 is not really between U and L, my guess is as good as
random, and I am right 50% of the time.
Note: we have here a strategy that (depending on U,L) can increase our
odds of guessing correctly. This is essentially a model for what
happens in my complex strategy.
We can see clearly why this simple strategy "works": If I do have a
number y that lies between U, L (y=0 in this strategy) then I can figure
out which number I have drawn by comparing it to y: if x < y, I must
have x = L, etc.---I guess right 100% of the time when I have such a
in-between point y.
Because we know nothing about U,L, we don't _know_ such a y for sure,
so we can't have a guaranteed advantage.
Moral: having a y between U,L guarantees you can guess with 100%
accuracy. Without such y, your accuracy drops to 50%.
Since we need such a y to get an edge, but don't know one, we may as
well pick one randomly---there is some chance that we get a "good" y,
and that will boost our accuracy. If we get a "bogus" y, our accuracy
stays at 50%.
This leads to the following strategy (essentially the same as the one I
gave originally, but more simply stated):
(1) Try and guess a y lying between L, U by choosing y randomly (from
your favorite prob. density, eg Gaussian).
(2) assume y lies between U and L, and guess about x accordingly; ie
assume the picture:
<-------*------y----*------->
L U
so we guess x = L if x < y, or guess x = U if x > y
The probability of a correct guess using this scheme is easy to find;
the result is:
(a) If y is between U, L we will guess x correctly
(b) If y is not, our guess will have 50-50 accuracy:
which leads to the probability of a correct guess being:
P[correct guess about x] = (prob. of y between U, L)*1
+ (prob of y not between U,L)*(1/2)
= P[ L<y<U ]*1
+ ( 1 - P[ L<y<U ] )*(1/2)
= (1/2)*( 1 + P[ L<y<U ] )
Note this is the exact same probability we computed in my previous
post, although there it took a more complicated argument, and it was
not clear why it worked.
So, we can summarize the "magic strategy", and its effects very
intuitively as follows:
Game: L < U are in a hat. We draw a number from the hat, x, and must
guess if x = U or x = L.
Strategy: we try to guess a y lying between L and U, and determine our
x guess based on the assumption L < y < U.
Result: This assumption is right with probability P[ L < y < U], and in
that fraction of the time, we guess x correctly. Otherwise, our x guess
has 50% accuracy.
Note:
The Simple Strategy discussed initially (take y = 0) corresponds to the
special case of the general Strategy, in which y is a random variable
concentrated at the origin (---i.e. when you draw y, it is always 0).
So the motivating example I considered fits nicely into the general
scheme.
The answer to the four original questions:
Q1 "Why can my odds exceed 50%?"
A1 "If you know a number between U,L your odds jump to 100%. You can't
be sure you have such a number, but you can guess one and have some
chance of it being so. This _chance_ of knowing such an in-between
number increases your odds."
Q2 "What am I really doing by using this prob. density mumbo-jumbo,
and why does my advantage depend on P[L < y < U]?"
A2 "You are trying to guess a number that lies between L, U. Drawing a
number according to some probability distribution is the formal
method of "guessing". Since your odds are only enhanced when you
find y with L < y < U, your odds depend on the probability of this
being correct.
Q3 "How can I see simply what my odds are?"
A3 "You get 100% accurate x guess if y is between U,L---this occurs
P[ L < y < U ] of the time. You otherwise get 50% accuracy in your
x guess."
Q4 "What have we learned from this "paradox"?" <---most important
A4 "If you can have an advantage by knowing a number y that has
property X, then you can also have a (lesser) advantage by trying to
guess such a number. As long as your guess has some probability of
having property X, you are be better off (unless mistakenly thinking
y has X hurts you).
To illustrate our new found insight, here is a much simpler game and
strategy with the same paradoxical features. You can all go out and
make up your own too---just make use of A4.
Game: the dealer has picked a real number N, and you know nothing about
it or how he selected it. You have to guess whether N is
positive or negative.
"Paradox": You can have a better than 50% chance of guessing the sign
of N correctly.
Strategy: If we knew a number y between N and 0, we could guess the
sign of N accurately. We don't have such a y, but we "guess
y", by randomly selecting y (from, e.g. a Gaussian
distribution.) By our standard argument,
P[guessing sign of N] = (1/2)* ( 1 + P[ y between N,0])
As long as y has nonzero probability of lying between 0 and N (which it
would if it was chosen with Gaussian density) we have increased our
odds above 50%.
Well, probability is fixed and I can sleep at night again... :-)
-- Barry Merriman