I love washable tempera paint (and yes, it's actually washable). Watercolor paints also work well with painting ice cubes.