Still fix permissions on files if they aren't links