Title: Applied Markov Based Modelling of Random Processes