hadoop implementation cleaned