## Uses of Class
jmarkov.jmdp.MDP

- Packages that use MDP
  Package | Description
  --- | ---
  examples.jmdp |
  jmarkov.jmdp | jMDP is used to solve Markov Decision Processes.
  jmarkov.jmdp.solvers | This package contins the framwork of solvers used by jMDP to solve Markov Decision Processes.

- - ### Uses of MDP in examples.jmdp

    Subclasses of MDP in examples.jmdp
    Modifier and Type | Class and Description
    --- | ---
    `class` | `AccessControl` The present example describes a two station tandem queuing system, with capacity b1 in the first queue and b2, in the second.
    `class` | `AccessControlFiniteHor` The present example describes a two station tandem queuing system, with capacity b1 in the first queue and b2, in the second.
    `class` | `Bank2Queues` The present example describes a Bank office with "maxServers" tellers.
    `class` | `CattleGrowth` The Cattle Growth problem represent a male cattle, the states represent the weight at different ages.
    `class` | `ControlProdNonEvents` The problem is a periodic review, single item, stochastic demand inventory problem.
    `class` | `ControlProduccion` This problem is periodic review, a single item, stochastic demand inventory problem.
    `class` | `CowHerd` The cow herd problem.
    `class` | `CTInventory` This class describes an inventory system with two items.
    `class` | `CTInventoryEvents` This class describes an inventory system with two items.
    `class` | `InfStochasticDemand` This problem is a single item, periodic review, stochastic demand inventory problem.
    `class` | `Inventory` A periodic review inventory system that is exposed to random demand.
    `class` | `LeadTimeStochasticDemand` This file models a multi item inventory problem.
    `class` | `OrderProcessing` A company receives orders at a random rate.
    `class` | `ProbsExample` Basic example to show convergence of probabilities with probability solver.
    `class` | `StochasticDemand` This class belongs to the examples supplied in the package jmdp.
    `class` | `WagnerWhitin` This example solves a deterministic, dynamic lot-sizing problem, also known as a Wagner Whitin problem.

  - ### Uses of MDP in jmarkov.jmdp

    Subclasses of MDP in jmarkov.jmdp
    Modifier and Type | Class and Description
    --- | ---
    `class` | `CT2DTConverter<S extends State,A extends Action>` This class formulates a DTMDP equivalent to a CTMDP.
    `class` | `CTMDP<S extends State,A extends Action>` This class represents a continuous time MDP.
    `class` | `CTMDPEv<S extends State,A extends Action,E extends Event>` This class represents an Infinite horizon, continuous time Markov Decision Process with events.
    `class` | `CTMDPEvA<S extends State,A extends Action,E extends Event>` This class represents an Infinite horizon, continuous time Markov Decision Process with events where actions depend on events.
    `class` | `DTMDP<S extends State,A extends Action>` This class represents a discrete time infnite horizon MDP problem.
    `class` | `DTMDPEv<S extends State,A extends Action,E extends Event>` This class represents an infinite horizon, discrete time, Markov Decision Process with events.
    `class` | `DTMDPEvA<S extends State,A extends Action,E extends Event>` This class represents an infinite horizon, discrete time, Markov Decision Process with events, where actions depend on events.
    `class` | `FiniteDP<S extends State,A extends Action>` This class should ONLY be used in FINITE horizon deterministic problems.
    `class` | `FiniteMDP<S extends State,A extends Action>` This class should ONLY be used in FINITE horizon problems.
    `class` | `FiniteMDPEv<S extends State,A extends Action,E extends Event>` This class represents a finite horizon discrete time MDP with events.
    `class` | `InfiniteMDP<S extends State,A extends Action>` This class is a structural class.
    `class` | `StochasticShortestPath<S extends StateC,A extends Action>` This class represents an infinite horizon shortest path problem.

  - ### Uses of MDP in jmarkov.jmdp.solvers

    Methods in jmarkov.jmdp.solvers that return MDP
    Modifier and Type | Method and Description
    --- | ---
    `MDP<S,A>` | Solver.`getProblem()` Returns the problem associated wit this solver.