XD-997 Adding initial partitioning support for hdfs-dataset sink

* Test that writes to local files using Hadoop API
* Javadoc polish in integration.hadoop packages