St. Anne's Church (facing Anne Street South) has some colorful 19th-century stained glass, and provides the setting for lunchtime concerts (look for the notices in the vestibule).
Visitors to St. Anne's Church can listen to a lunchtime concert and admire the old stained glass.