add hadoop partitiion func

Signed-off-by: Mingxi Wu <thisisforivy@gmail.com>
add comment

Signed-off-by: Mingxi Wu <thisisforivy@gmail.com>