Harrison and his wife returned to live at The Point, his father's farm in southwestern Ohio, while he finished his law studies. Harrison was admitted to the Ohio bar in early 1854, the same year he sold property that he had inherited after the death of an aunt for $800 (equivalent to $22,764 in 2019), and used the funds to move with Caroline to Indianapolis, Indiana. Harrison began practicing law in the office of John H. Ray in 1854 and became a crier for the federal court in Indianapolis, for which he was paid $2.50 per day. He also served as a Commissioner for the U.S. Court of Claims. Harrison became a founding member and first president of both the University Club, a private gentlemen's club in Indianapolis, and the Phi Delta Theta Alumni Club. Harrison and his wife became members and assumed leadership positions at Indianapolis's First Presbyterian Church.