You can try it, but keep in mind that your end result will likely be crumblier, and things like cakes and cupcakes may be more prone to sinking, without the xanthan gum to provide extra structure to hold them up.