Yes, you should. Not only does it make your pond look great it provides tons of surface area for beneficial bacteria colonies to flourish and help maintain a chemical balance in your koi pond. Just make sure you get gravel larger than the nozzle size of your pond vac!