Remove old plugin-name folder