Skip the file stat on paths with permission errors