Bags of dry play sand (usually 50-pound bags) found at home improvement stores can be used to fill an umbrella stand. Adding water to sand will add to the weight of the stand, but it could be a challenge to drain and clean at the end of the season. In a pinch, you could use cat litter to fill and weigh down your umbrella stand.