Removing the Grass If you lay plain gravel over the top of grass it's going to migrate and spread, even if you put a weed cover beneath the gravel to prevent weeds from popping up. The first step to adding gravel on top of grass is actually to remove the grass before you go any further.