datasysdev commited on
Commit
2ce90b1
·
verified ·
1 Parent(s): 0585058

Correct asymptotic scoring analysis

Browse files
Files changed (1) hide show
  1. artifacts/scaling_table.csv +12 -0
artifacts/scaling_table.csv ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ context_length,full_flops,quest_flops,learned_flops,quest_speedup_vs_full,learned_speedup_vs_full,learned_speedup_vs_quest
2
+ 4000,512000,64000,3136759,8.00,0.16,0.02
3
+ 8000,1024000,128000,3398903,8.00,0.30,0.04
4
+ 16000,2048000,256000,3661047,8.00,0.56,0.07
5
+ 32000,4096000,512000,3923191,8.00,1.04,0.13
6
+ 64000,8192000,1024000,4185335,8.00,1.96,0.24
7
+ 128000,16384000,2048000,4447479,8.00,3.68,0.46
8
+ 256000,32768000,4096000,4709623,8.00,6.96,0.87
9
+ 512000,65536000,8192000,4971767,8.00,13.18,1.65
10
+ 1000000,128000000,16000000,5224942,8.00,24.50,3.06
11
+ 2000000,256000000,32000000,5487086,8.00,46.66,5.83
12
+ 4000000,512000000,64000000,5749230,8.00,89.06,11.13