You can use sand or gravel to fill the base of your zen garden, but experts recommended gravel over sand since sand can be messy outdoors, especially with wildlife.