The fbtft_driver needs to be loaded way after its arch init slot.  "Work around" this by building it as a module.