What time you choose to serve dinner is a personal choice. Some families serve it on Christmas eve. Others choose to gather family and friends for Christmas dinner on the actual day. In terms of time of day, it can be served anywhere from noon through the evening.