St. Mark's Episcopal is the oldest original church structure in the town of Raymond. In 1858, a disastrous fire destroyed many businesses in town. The office of the Hinds County Gazette was one of the buildings that burned. Temporarily, George Harper, owner and editor of the Gazette, used St. Mark's Episcopal Church to print the paper. In 1863, following the Battle of Raymond, the church was used as a hospital to treat wounded Union soldiers.
Blood stains are still visible on the wooden floor.
St. Mark's Episcopal is listed on the National Register of Historic Places.