I was thinking about the idea that some other file was watched for the sake of evicting all of the caches - say puppet.conf, but I don't know what happens now if you touch that file.