These numbers are not extreme when you consider the biological realm. Many bacteria may replicate in less than an hour. Bacteria must use some clever tricks to do this. The difference in replication times is due to several factors. There must be multiple checkpoints where the cell decides that the DNA has been copied and that any necessary repairs have been completed.
Eukaryotic cells have a much more complex structure than bacteria.
Multiple chromosomes, chromosome packing and a nuclear membrane require that there must be more steps to the division, such as breaking down the nuclear envelope, alignment and separation of the chromosomes and reassembly of the nuclear envelope after the cells have divided. Bacteria only have a few thousand varieties of these machines while Eukaryotic cells have tens of thousands. Eukaryotic cells are also much larger, with perhaps 1,000-10,000 times the volume of a bacteria, so division processes which may occur quickly via diffusion in bacteria may require active management in a eukaryotic cells. Because these active management processes have been designed in a very ad-hoc fashion by nature, they are likely to be suboptimal. The large size of the cells delays the time it takes for molecules which regulate the steps of the cell division sequence to diffuse to the locations where they perform their functions.