various codes used between crawljax and nutch