S
- States classA
- Actions classpublic abstract class FiniteMDP<S extends State,A extends Action> extends MDP<S,A>
FiniteSolver
Constructor and Description |
---|
FiniteMDP(S initial,
int horizon)
Creates a finite horizon MDP.
|
FiniteMDP(States<S> initial,
int horizon)
Creates a new FINITE horizon (MDP) Problem.
|
Modifier and Type | Method and Description |
---|---|
double |
defaultFinalCost(S i)
This method returns the cost incurred if the last stage ends
with the system at state i choosing the best immediate cost.
|
abstract Actions<A> |
feasibleActions(S i,
int t)
Returns the actions available at this state i and at this stage
t .
|
abstract double |
finalCost(S i)
This method returns the cost incurred if the last stage ends
with the system at state i.
|
int |
getHorizon()
Returns the time lastStage
|
States<S> |
getStates(int t)
All the states that are available at stage t.
|
abstract double |
immediateCost(S i,
A a,
int t)
This function must return the Immediate cost incurred when
taking action a from state i
|
abstract double |
prob(S i,
S j,
A a,
int t)
This is the probability of going from state i to state j by
taking the action a at stage t.
|
abstract States<S> |
reachable(S i,
A a,
int t)
Set of States that can be reached from this state i, at this
stage t, after taking the acton a.
|
debug, debug, debug, getDebugLevel, getOptimalPolicy, getOptimalValueFunction, getReporter, getSolver, isFinite, isSolved, operation, printSolution, printSolution, setDebugLevel, setReporter, setSolver, solve
public FiniteMDP(States<S> initial, int horizon)
initial
- set of initial stateshorizon
- last stage at which actions can be takenpublic FiniteMDP(S initial, int horizon)
initial
- a initial statehorizon
- horizon.public abstract double immediateCost(S i, A a, int t)
i
- Current statea
- Actiont
- Current time stagepublic abstract double prob(S i, S j, A a, int t)
i
- Current statej
- Destination statea
- Action takent
- Current time stagepublic abstract States<S> reachable(S i, A a, int t)
i
- Current statea
- Action takent
- Time stagepublic States<S> getStates(int t)
t
- time stagepublic abstract double finalCost(S i)
i
- Ending statepublic final double defaultFinalCost(S i)
i
- Ending Statepublic abstract Actions<A> feasibleActions(S i, int t)
i
- Current Statet
- Time stagepublic int getHorizon()