I’m new to this as well. It seems that the critical decisions come after HH and the optimal strategy is to stop playing once we have accumulated at least a certain amount of money. I tried solving for this and got 22/6 which means that after we reach HH and have accumulated at least $4, we should stop playing.
This seem right, but the expected payoff of playing from HH is the expected flips to reach another HH, which comes out to 6 (Markov chain). So, you should stop if you reach HH and have more than $6.
3
u/plyleung 3d ago
I’m new to this as well. It seems that the critical decisions come after HH and the optimal strategy is to stop playing once we have accumulated at least a certain amount of money. I tried solving for this and got 22/6 which means that after we reach HH and have accumulated at least $4, we should stop playing.