Fig. 8
From: Reachability-based model reduction for Markov decision process

A stochastic bisimulation example. An MDP M of five states partitioned in two blocks (upper) that is reduced to an MDP M ′ with two abstract states (lower)
From: Reachability-based model reduction for Markov decision process
A stochastic bisimulation example. An MDP M of five states partitioned in two blocks (upper) that is reduced to an MDP M ′ with two abstract states (lower)