Kelley begins losing interest in the Grange as he loses some control to other administrators. By 1875, the Grange begins to decline in popularity. The move to Louisville sours him, and he begins to build his new house in Minnesota, hoping to move his secretarial office back to the old homestead. He also buys 29 more adjoining acres. Grange membership begins to wane after reaching a peak of 858,050 in 1875.
Cooperative ventures begin to fail.
1878 Kelley becomes deeply involved in real estate speculation in northwestern Florida. He moves his office and Grange records there, but soon resigns his position. He has little contact with the Grange for the next 16 years. He founds a new city-Rio Carabelle. Fla., and begins to promote it as the biggest port between Tampa and Mobile.