But as a general rule of thumb, pool parties are pre-dinner parties, especially if you want to include some swimming and pool games while it's nice and hot outside. So, the ideal time for a pool party to start would be 3:00PM. It should last for two or three hours.