token freq discrepancy functions working with multiple metrics.  current state of notebooks