In Stardew Valley, after marrying a character, there's a chance your spouse will ask if you'd like to have a baby. Ensure you have an upgraded farmhouse with a nursery. If both conditions are met, sleep, and you might be prompted about having a baby. In a few days, the baby will appear in the crib.