Adding compost after removing rocks is highly recommended. Compost can enhance soil structure, add essential nutrients, improve moisture retention, and promote microbial activity. By incorporating compost, you can further enrich the soil and create an optimal growing environment for plants.