The best way to get to the Port Authority from the Times Square bus terminal is by IRT Street Shuttle from 42nd street.