Cleans up plugins when trying to install without bundler