Commit History

Update src/get_results_for_task.py
fcf16bd
verified

jenyag commited on

Add dataset field to code completion task
f2f6f8f
verified

jenyag commited on

Fix METRICS_PER_TASK
94b3985
verified

jenyag commited on

Update COLUMNS_PRETTY
5ee35e1
verified

jenyag commited on

Add columns for project-level code completion
dba91fa
verified

jenyag commited on

🏟️ Update emoji 🏟️
4478ebc
verified

saridormi commited on

Add refresh button to leaderboard
b7e5123

saridormi commited on

Tweak concurrent tasks limit (as more than 1 seems to break) and rearrange CMG metrics to match the leaderboard
5e9b929

saridormi commited on

Hide submission blocks by default
96ff3bc

saridormi commited on

Display urls on the leaderboard, tweak interface a little and fix CMG descriptions
04f40cd

saridormi commited on

Fix url rendering for the leaderboard
a9273cf

saridormi commited on

Add a separate textbox for model url and toss textboxes around
2d26479

saridormi commited on

Fix the first submission for the task case and tidy up code a bit
a70fbd7

saridormi commited on

Add queue() call for processing several requests at the same time
0646a3e

saridormi commited on

Remove previous attempt at adding folders, as it doesn't work :( also, remove dataset name from exceptions
afb227e

saridormi commited on

Handle cases for first submissions for the task
65ca2c6

saridormi commited on

Add a separate dataset for aggregating requests metadata
04b315a

saridormi commited on

Make files submissions instructions task-specific & other small changes
6c92442

saridormi commited on

Remove urls from leaderboard
2770288

saridormi commited on

Fix formatting
dc801c4

saridormi commited on

Fix metrics formatting and add sorting
aa8b23d

saridormi commited on

Fix leaderboard formatting
adc61b7

saridormi commited on

Fix tasks data retrieval
2d0af54

saridormi commited on

Start rendering actual data + minor improvements
9203553

saridormi commited on

Fix temp directory being deleted too early.
d47b526

saridormi commited on

Add missing packages for CMG metrics
6ff0136

saridormi commited on

Remove extra import
5d84797

saridormi commited on

Add metrics computation for CMG task
cdf268e

saridormi commited on

Fix paths
1323fe2

saridormi commited on

Fix returns and file names
2d1a3df

saridormi commited on

Fix more issues with repo type
1a033b9

saridormi commited on

Fix CMG name mapping
338ab1d

saridormi commited on

Fix dataset link
66f3095

saridormi commited on

Add initial space version
e2473e2

saridormi commited on

initial commit
779249f

saridormi commited on