The stones came to Charleston on British ships that used them as ballast on their trip over from England.