New York City 's western edge limits with New Jersey 's northern and eastern border .
It is a peninsula , bordered on the north and east by the state of New York ; on the east , southeast , and south by the Atlantic Ocean ; on the west by the Delaware River and Pennsylvania ; and on the southwest by the Delaware Bay and Delaware .
New Jersey