To clean an oil dispenser, you should first rinse it with warm water to remove any loose dirt or debris. Then, fill the dispenser with a mixture of warm water and a small amount of mild dish soap. Swirl the water and soap mixture around inside the dispenser, then rinse it thoroughly with warm water. If the dispenser has a removable spout or pump, you should remove it and clean it separately.