Object and Hydrator Element Annotation did not work as expected

See my [test module](https://github.com/CrisMKM/AnnotationBuilderTest/tree/ElementObjectAnnotation) for this error.

The Hydrator and Object elementspec have no effect if not in the 'spec' sub-array due to `Zend\Form\Factory->prepareAndInjectFieldsets()` behaviour.