That's a personal choice. The oils are full of skin-soothing vitamins and humectants, which will leave your skin feeling soft and moisturized if left on. But if the thought of being slathered in oil makes you feel gross, then yes, go ahead and give yourself a quick rinse.