improved face selection with mouse by detecting first square hit by viewing ray