Wait until the lemon loaf is fully cooled so it doesn't melt off the cake, then pour on the glaze. You can serve it right away or allow it to set for an 30-60 minutes.