Cleveland, the fifth of nine children, was named Stephen Grover in honor of the first pastor of the First Presbyterian Church of Caldwell, where his father was pastor at the time. He became known as Grover in his adult life. In 1841, the Cleveland family moved to Fayetteville, New York, where Grover spent much of his childhood. Neighbors later described him as 'full of fun and inclined to play pranks,' and fond of outdoor sports.