Pond sediment can be beneficial for gardens as it contains nutrients that can enrich the soil. However, too much pond sediment can lead to compacted soil or nutrient imbalances, so it's important to use it in moderation and ensure proper soil management.