The asparagus stalk has a tough exterior and a fibrous interior. The inedible part of the asparagus plant is the lower third of the stalk, which is where the majority of the fiber is located.