caculate tokenized file hash from repositories