What is MDP (Markov decision problem/process)?

Russian mathematician Andrey Markov gives the name of Markov decision problem/process, as they are an augmentation of Markov chains. It gives a numerical system to demonstrate decision making in circumstances where results are partly random. MDPs are valuable for concentrating on improvement issues settled by means of dynamic programming. They are utilized in many disciplines, incorporating mechanical technology, automatic control, economics and assembling.