Travertine is a porous stone and will absorb water and minerals from the surrounding soil over time. This can cause the stone to lose its color, become porous, and eventually crumble. If you notice any of these signs, it's best to fill in the hole with a material that won't affect the stone's durability.