There is no need to delete inactive plugins. You should delete them only if you want to save space on your server or if you need to clean up the mess in your plugins tab.