Church service
Cummins' Evangelical theological persuasions led him to separate from the Episcopal Church, which had, in his mind, been poisoned by the ritualism of the Anglo-Catholic party. Before he left the Episcopal Church, Cummins as bishop engaged in a highly provocative Church service in which he presided alongside a Presbyterian clergyman, Dr. John Hall, over Holy Communion at Hall's Fifth Avenue Presbyterian Church.