ive updated this.  no longer do we dupe tha hadoop code