The leaves and stalks that you removed from the plant base are great for compost and introducing natural nutrients back into the soil, hence, you can reuse those parts. Take the leaves and stalks and toss them in your compost bin as a green component to balance out the existing compost. These nutrients will be ready to replenish the soil around the asparagus plants in the Spring.