bcm21553-common: More cleanup