Yes, you can use frozen tater tots straight from the bag. There's no need to thaw them before assembling the foil packets. The heat from the grill will cook them to a crispy perfection.