The first church building had been erected by the American Episcopalian parish of the Holy Trinity between 1863 and 1864, who then moved to their new church in 1885. It was because of this move to a newly built church that they decided to put on sale their old church Rue Bayard. This church was designed in a neo-Gothic style and could host about persons. The recently purchased church then attracted high attendance to the services held during the Exposition Universelle of 1889.