Exit Canal Street East. Turn right on Spring St and left on Lafayette Street. Right on Houston, Left on Broadway, Left on Spring St, Left on Lafayette. Don't hesitate to use the NYC subways. On Saturdays the subways run a bit slower.
Cabs are faster though more expensive.
On weekdays cab rides can take a long long time. The Prince Street Station of the N and the R trains connects with mid town and the upper west side as does The Broadway-Lafayette St Station of the Q, B, or F Train. If he doesn't know where that is get out and get a new cab. You have a problem driver.