Unless your chicken run is completely predator-proof, you should always close the coop door at night before going to bed. Additionally, you may want to consider adding an automatic door like this one to ensure your chickens are always safe and secure.