replacing troublesome characters
adjusting for new file tree structure, and including a utility function for pos tagger