A somewhat working algorithm

algorithm mainly breaks when there is other objects of the same color as
one of the finger's around.

however, since the algorithm starts it's search from the last known
position of the hand, it's not as bad as it could be.