To clean the inside of an oil lamp, empty any old oil and wipe the reservoir with a damp cloth. Use mild soap and water for residual grime, then rinse and dry thoroughly before refilling with fresh oil.