The paving stones were brought from Spain as ballast in ships returning with gold.