Only check for paths when the task is actually executed.