[brcm63xx] Fix HS SPI bug from last commit.