To clean an oil-absorbing sponge, rinse it thoroughly with clean water after each use to remove the absorbed oils and lotions. Periodically, you can soak the sponge in a mixture of mild detergent and water, then rinse it to ensure it's clean and ready for reuse.