Oily skin is most common among teenagers. Keep your skin clean. Hot soapy water is even better. Ivory soap is a more drying soap than many others. Scrub the skin with soap and water.
Some people put mud masks on to remove oil.
Fortunately, oily skin tends to age better than dry skin, producing less wrinkles. So count yourself fortunate in one way. God cares for our necessities, and His love and grace are continually flowing, to satisfy our needs. In His care, we may safely rest. Hot weather, dry skin, sweaty skin.