pinctrl: at91: clean the driver