When you simmer a fresh chicken — complete with bones, skin, and meat — you extract the collagen from the bones. This collagen in the bones is what is causing your soup to gel. It's completely natural, and it only happens in rich, well-made chicken stock. It can be a little freaky, though, if you're not expecting it!