We do not recommend leaving the dip out overnight. When stored at room temperature for too long, bacteria can develop in the dip. However, the dip can stay for six hours on the warm setting in the crockpot before it needs to be placed in an airtight container and chilled.