MARKOV DECISION PROCESSES WITH THEIR APPLICATIONS