Moved everything over from wxpython to pygame.  Seems to be working MUCH better.
Started to move away from wxpython and looking more towards pygame.  Seems to be going much more smoothly now.