jMDP is used to solve Markov Decision Processes. See the jMDP manual for details.