Ensure same atime, mtime after applying whiteouts