Turns out the left sensor was loading everything and made this whole thing be ridiculous.  Finally have the algorithm working.  Works going both ways in the maze.  I don't think I am going to try and come up with a speed maze algorithm.