It's not necessary to take apart the spray head to clean all of these parts, and luckily, you don't have to. All you'll need is white vinegar that has been distilled and a bowl that is big enough to hold the spray head. Soak the whole spray head, including the aerator, for a few hours or, better yet, overnight.