Made tests more similar to python tests.
Implemented annealing epsilon greedy algorithm.
Ignore generated R graphs.