Markov Leftover and Nested Expectation

Stay 0.7, exit 0.3, γ = 0.9, reward 1 on arriving in s0: v(s0) = 1.8919. Paying before moving gives 2.7027, dropping γ gives 2.3333, and a max gives 10.

This Probability lesson is part of a paid plan. Sign in with a plan that includes this course to read it.