There are many ways to honor a baby who was lost during pregnancy or infancy, such as lighting a candle, releasing balloons, or planting a tree in their memory. You can also create a memory box or scrapbook, or hold a memorial service.