Stop currently active plugin on exit