Casey did not re-enter parliament, though he unsuccessfully contested Sandridge (now Port Melbourne) in 1883. Casey, who was the first President of the Federal Bank of Australia, was Executive Vice-President of the Melbourne International Exhibition (1880), and in that capacity, and as Chairman of the Great Britain Committee, contributed much to its success. In April 1884 Casey, who is the author of "Casey's Justices' Manual," was appointed a County Court Judge; and in July 1885 he assumed the additional functions of a Land Tax Commissioner, being for a short time in that year an Acting Judge of the Supreme Court of Victoria. Casey married Maria Teresa, daughter of John Cahill and Mary McNamara his wife, of Bendigo; there were no children.