Stockton was born in 1751, the youngest of the eight children of John Stockton and his wife Abigail, at Morven, the family estate in Princeton, New Jersey. He was the brother of Richard Stockton, a signer of the Declaration of Independence.