[markov_chain_test.py] included more detailed test about preallocated memory