add new methods for tests of hadoop