[DO NOT MERGE YET] XD-1461 Use hadoop minicluster for tests

- NOTE: for now this PR is just for review order
  to see if it works for others.
- First changes to see if we can use minicluster
  instead of a real hadoop cluster for tests.