Turns out $CDPATH already does that