You can keep the brownies in an airtight container at room temperature for at least a few days even with the sweetened condensed milk frosting. Individual brownies can also be frozen for up to three months in a freezer-safe baggy.