File Manager Plugins are generally optimized for performance. However, it's essential to choose a well-coded plugin and regularly update it to maintain optimal website speed. Since these types of plugins are mainly loaded in the admin dashboard, that's where the performance could suffer. However, the website itself will load the same as without the plugin.