To clean floating candle holders, empty the water and gently wipe the holders with a soft cloth or sponge. If there is any residue left, you can use mild soap and warm water to remove it. Make sure to dry the holders thoroughly before using them again.