Your baby may be okay in just a diaper underneath their swaddle if their nursery is warm enough. If it’s cooler in your nursery or outside, it’s probably best to dress your baby in a short or long-sleeved onesie to ensure that they’re warm enough. However, it’s also important to ensure they don’t overheat, so keep an eye out for sweating and flushed or hot skin.