MMLU-by-task-Leaderboard / test_data_processing.py

Commit History

MC1 column had 8 rows with a value of 1. It didn't make sense given the next highest value was 0.47 . Assuming they were data errors, they were removed
e03b231

Corey Morris commited on

truthfulqa data added to dataframe
abac22e

Corey Morris commited on

Added test for removal of undesired columns. fixed code error in column removal
9549fcc

Corey Morris commited on

Added initial tests. test_columns and test_rows will be updated or removed later as they test for the exact number of columns and rows. the number of rows will change as more models are added
85667d0

Corey Morris commited on