Finally got the mouse pointer giving world coordinates working properly.
Now the player will follow the last mouse selection.