In otherwise healthy children and adults, accidentally swallowing an olive pit will not cause much harm. They will most likely exit the body unnoticed through stool. The risks are greater on an empty stomach, and if a big number is accidentally ingested.