Yes, cakes with cannoli cream are dairy-based and need to be kept refrigerated. When serving, do not leave it out at room temperature for longer than 2 hours.