Yes, you can substitute water for the chicken broth. However, chicken broth adds extra flavor to the grits, so you may need to add more salt to the recipe if you choose to use water instead.