Yes! And this is a good thing and a sure sign you have made an excellent Chicken Stock. What happened is that the collagen from the chicken bones causes the soup to gel. Well-cooked stock will have a rich depth of flavor.