Add USB_HOST_ALIGN=64; the cache line size on the am335x is 64 bytes.