It is the `Form\Factory` who is creating and configuring the fieldset here, then IMO `Form\Factory` is the best one to set the object and hydrator.
If you want to remove this responsibility from the `Form\Factory`, so you'll have to create a specific factory for the fieldset, but we want to be more simple here.

Anyway,It was just a suggestion. :wink: