Before the library's establishment, the site was home to Christ Church, an English Presbyterian chapel built in 1881.
Cyn sefydlu'r llyfrgell, roedd y safle yn gartref i Eglwys Crist, capel Presbyteraidd Saesneg a adeiladwyd ym 1881.