The best way to get Seafarer's Cowries is to keep going through the visions, keep the workshop/granary going, and keep an eye on the challenge log. If you only do one of these, complete the visions and make up the rest of the cowries anywhere.