The leftover rice milk pudding can be kept in the refrigerator for up to five days in an airtight container. The pudding thickens when it is cold, so reheat it over low heat and add more milk as needed to thin it out.