Track modification time of configuration file and reload it if it was externally modified before changing settings