In general, only users with access to the website's hosting control panel or FTP account can access the website's file manager. Website owners and administrators can set permissions and restrict access to certain users or user groups for security purposes.