[brcm63xx] Switch to physmap.