If you notice an olive oil stain reappearing after washing, simply re-treat the area with dish soap or baking soda and wash again. With repeated washing and re-treating, you can fully remove even stubborn oil stains. Just don't use fabric softener or dryer sheets when drying previously stained clothes.