Remove one asparagus stalk once you can see the color begin to change. Asparagus will be bright green and still firm, but not soft or bendy. Asparagus doesn't take long to steam/grill/boil/fry. You want the asparagus to remain slightly crunchy, but not raw, in the middle.