As long as the paint (such as tempera paint) is watered down enough, it should work.