manifest: Remove vesa / cirrus drivers

Just build -qxl and -modesetting.