Yes, using frozen rhubarb can be used to make this coffee cake. Just make sure to thaw it and pat it dry before tossing it with some gluten free flour. It will release a lot more moisture than fresh rhubarb during baking.