Remove sysfs attributes when removing driver to prevent error when driver is loaded again.