What changed from v2.0

#1
by Overbite1741 - opened

I tried 2.0 few days before. There is a significant difference in benchmarks between 2.0 and 2.1 and I am curious what changed from that training. From README only thing I see changed is epochs.

Thanks. And really appreciate you making uncensored models.

Cognitive Computations org

The data was the same.
Only two things changed.

  1. The ChatML tokens were added
  2. The hyperparameters were modified
ehartford changed discussion status to closed

Sign up or log in to comment