Built in 1840, the church originally looked out onto the River Frome. However, the water was covered over in 1893, forming what is now Colston Avenue this mark indicates this.