And then they happen. The biggest problem is that it's impossible to get hold of anything or anyone - they're all asleep, the weirdoes. Something breaks, someone drops out, you need a prop - ruined. Then there's the crew. Easily agitated at the best of times, a crew's temper tends to be on a really fine line once they're asked to work nights.
People also tend to fall asleep - usually the producers for a start.
Then there's the public - also trying to sleep. If you piss someone off enough they'll inevitably piss you off even more. There are also lots of advantages to shooting at night. The best one being that you go a little bit insane and it all seems a lot more dramatic.