To get to Kingston, New York from NYC by train, you can take an Amtrak train from Penn Station to Rhinecliff-Kingston Station.