Any kind of oil (such as mineral oil, vegetable oil, or baby oil) should break down the adhesive so you can wipe the residue off. Then, clean the area with a cloth dipped in soapy water.