Diogo-V's picture
Upload results for llama3
573af4b verified
accuracy bits clip dataset method model params peak_mem_alloc_mb peak_mem_reserv_mb perplexity time_ms wer
0.4277946949005127 4 0.0 wikitext ao_woq llama3 fixed 5542.3616 7163.871232 5.3583574295043945 39.48326 0.0
0.4437352418899536 8 0.0 wikitext ao_woq llama3 fixed 12110.375936 14040.43264 5.208643436431885 52.325705 0.0
0.0 4 0.0 wikitext comb_4 llama3 rnd_affine_scale 14178.745344 15367.929856 1.3576891422271729 122.24036 0.0
0.0 5 0.0 wikitext comb_4 llama3 rnd_affine_scale 14178.745344 15367.929856 1.3576891422271729 122.24036 0.0
0.0 6 0.0 wikitext comb_4 llama3 rnd_affine_scale 14178.745344 15367.929856 1.3576891422271729 122.24036 0.0
0.0 7 0.0 wikitext comb_4 llama3 rnd_affine_scale 14178.745344 15367.929856 1.3576891422271729 122.24036 0.0
0.0 8 0.0 wikitext comb_4 llama3 rnd_affine_scale 14178.745344 15367.929856 1.3576891422271729 122.24036 0.0
0.0 4 0.0 wikitext comb_10 llama3 rnd_affine_scale 14178.745344 15367.929856 1.1248141527175903 146.048446 0.0
0.0 5 0.0 wikitext comb_10 llama3 rnd_affine_scale 14178.745344 15367.929856 1.1248141527175903 146.048446 0.0
0.0 6 0.0 wikitext comb_10 llama3 rnd_affine_scale 14178.745344 15367.929856 1.1248141527175903 146.048446 0.0
0.0 7 0.0 wikitext comb_10 llama3 rnd_affine_scale 14178.745344 15367.929856 1.1248141527175903 146.048446 0.0
0.0 8 0.0 wikitext comb_10 llama3 rnd_affine_scale 14178.745344 15367.929856 1.1248141527175903 146.048446 0.0
0.380108118057251 4 0.0 wikitext comb_7 llama3 rnd_affine_scale 14179.216384 15367.929856 6.15098762512207 68.690887 0.0
0.4437352418899536 8 0.0 wikitext comb_7 llama3 rnd_affine_scale 14179.216384 15367.929856 5.208643436431885 68.711612 0.0
0.44049307703971863 6 0.0 wikitext comb_7 llama3 rnd_affine_scale 14179.216384 15367.929856 5.199138641357422 68.721497 0.0
0.435663640499115 5 0.0 wikitext comb_7 llama3 rnd_affine_scale 14179.216384 15367.929856 5.449023246765137 68.854208 0.0
0.44285714626312256 7 0.0 wikitext comb_7 llama3 rnd_affine_scale 14179.216384 15367.929856 5.2481889724731445 68.914664 0.0
0.44093209505081177 6 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.193300724029541 95.554673 0.0
0.4355623126029968 5 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.448963165283203 95.620613 0.0
0.4427558183670044 7 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.248887062072754 95.640183 0.0
0.3797703683376312 4 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 6.163248062133789 95.691252 0.0
0.44387033581733704 8 0.0 wikitext woq llama3 fixed 14179.331584 15367.929856 5.208242893218994 95.81458 0.0
0.0 4 0.0 wikitext comb_5 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.657542 0.0
0.0 5 0.0 wikitext comb_5 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.657542 0.0
0.0 6 0.0 wikitext comb_5 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.657542 0.0
0.0 7 0.0 wikitext comb_5 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.657542 0.0
0.0 8 0.0 wikitext comb_5 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.657542 0.0
0.0 4 0.0 wikitext comb_15 llama3 rnd_affine_scale 14185.276416 15374.221312 1.743079423904419 147.75742 0.0
0.0 5 0.0 wikitext comb_15 llama3 rnd_affine_scale 14185.276416 15374.221312 1.743079423904419 147.75742 0.0
0.0 6 0.0 wikitext comb_15 llama3 rnd_affine_scale 14185.276416 15374.221312 1.743079423904419 147.75742 0.0
0.0 7 0.0 wikitext comb_15 llama3 rnd_affine_scale 14185.276416 15374.221312 1.743079423904419 147.75742 0.0
0.0 8 0.0 wikitext comb_15 llama3 rnd_affine_scale 14185.276416 15374.221312 1.743079423904419 147.75742 0.0
0.0 4 0.0 wikitext comb_16 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.951061 0.0
0.0 5 0.0 wikitext comb_16 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.951061 0.0
0.0 6 0.0 wikitext comb_16 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.951061 0.0
0.0 7 0.0 wikitext comb_16 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.951061 0.0
0.0 8 0.0 wikitext comb_16 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 147.951061 0.0
0.0 4 0.0 wikitext comb_3 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 201.678928 0.0
0.0 5 0.0 wikitext comb_3 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 201.678928 0.0
0.0 6 0.0 wikitext comb_3 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 201.678928 0.0
0.0 7 0.0 wikitext comb_3 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 201.678928 0.0
0.0 8 0.0 wikitext comb_3 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 201.678928 0.0
0.0 4 0.0 wikitext comb_11 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 202.063101 0.0
0.0 5 0.0 wikitext comb_11 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 202.063101 0.0
0.0 6 0.0 wikitext comb_11 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 202.063101 0.0
0.0 7 0.0 wikitext comb_11 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 202.063101 0.0
0.0 8 0.0 wikitext comb_11 llama3 rnd_affine_scale 14185.276416 15374.221312 inf 202.063101 0.0
0.4368119239807129 5 0.0 wikitext comb_9 llama3 rnd_affine_scale 14185.747456 15374.221312 5.414428234100342 147.397096 0.0
0.44376900792121887 8 0.0 wikitext comb_9 llama3 rnd_affine_scale 14185.747456 15374.221312 5.212454319000244 147.576159 0.0
0.4405268430709839 6 0.0 wikitext comb_17 llama3 rnd_affine_scale 14185.747456 15374.221312 5.2111124992370605 147.609294 0.0
0.4443093538284302 8 0.0 wikitext comb_14 llama3 rnd_affine_scale 14185.747456 15374.221312 5.210572719573975 147.61511 0.0
0.4397501051425934 6 0.0 wikitext comb_9 llama3 rnd_affine_scale 14185.747456 15374.221312 5.200991153717041 147.633547 0.0
0.44322866201400757 7 0.0 wikitext comb_14 llama3 rnd_affine_scale 14185.747456 15374.221312 5.237606048583984 147.655695 0.0
0.3817291557788849 4 0.0 wikitext comb_9 llama3 rnd_affine_scale 14185.747456 15374.221312 6.142123699188232 147.690162 0.0
0.43562984466552734 5 0.0 wikitext comb_14 llama3 rnd_affine_scale 14185.747456 15374.221312 5.4294352531433105 147.703187 0.0
0.38054710626602173 4 0.0 wikitext comb_17 llama3 rnd_affine_scale 14185.747456 15374.221312 6.101458549499512 147.743066 0.0
0.4428909420967102 7 0.0 wikitext comb_9 llama3 rnd_affine_scale 14185.747456 15374.221312 5.240292072296143 147.766618 0.0
0.4435325860977173 8 0.0 wikitext comb_17 llama3 rnd_affine_scale 14185.747456 15374.221312 5.214560031890869 147.787915 0.0
0.3790949285030365 4 0.0 wikitext comb_14 llama3 rnd_affine_scale 14185.747456 15374.221312 6.18455171585083 147.802371 0.0
0.4408983886241913 6 0.0 wikitext comb_14 llama3 rnd_affine_scale 14185.747456 15374.221312 5.1934099197387695 147.882214 0.0
0.38098618388175964 4 0.0 wikitext comb_1 llama3 rnd_affine_scale 14185.747456 15374.221312 6.17535924911499 147.947141 0.0
0.435663640499115 5 0.0 wikitext comb_17 llama3 rnd_affine_scale 14185.747456 15374.221312 5.425045967102051 147.990046 0.0
0.44332998991012573 7 0.0 wikitext comb_17 llama3 rnd_affine_scale 14185.747456 15374.221312 5.235857009887695 148.047701 0.0
0.4432624280452728 8 0.0 wikitext comb_1 llama3 rnd_affine_scale 14185.747456 15374.221312 5.205002307891846 148.103647 0.0
0.4365755021572113 5 0.0 wikitext comb_1 llama3 rnd_affine_scale 14185.747456 15374.221312 5.4690375328063965 148.116906 0.0
0.4431273341178894 7 0.0 wikitext comb_1 llama3 rnd_affine_scale 14185.747456 15374.221312 5.243878364562988 148.144992 0.0
0.43978387117385864 6 0.0 wikitext comb_1 llama3 rnd_affine_scale 14185.747456 15374.221312 5.19732666015625 148.2511 0.0
0.44332996010780334 7 0.0 wikitext comb_6 llama3 rnd_affine_scale 14185.747456 15374.221312 5.223212718963623 175.140474 0.0
0.4409996569156647 6 0.0 wikitext comb_6 llama3 rnd_affine_scale 14185.747456 15374.221312 5.22392463684082 175.226501 0.0
0.4359675943851471 5 0.0 wikitext comb_6 llama3 rnd_affine_scale 14185.747456 15374.221312 5.412269592285156 175.238427 0.0
0.44424185156822205 8 0.0 wikitext comb_6 llama3 rnd_affine_scale 14185.747456 15374.221312 5.209920406341553 175.441786 0.0
0.38223573565483093 4 0.0 wikitext comb_6 llama3 rnd_affine_scale 14185.747456 15374.221312 6.119213581085205 175.734128 0.0
0.3783856928348541 4 0.0 wikitext comb_18 llama3 rnd_affine_scale 14185.747456 15374.221312 6.238375663757324 201.184932 0.0
0.44380277395248413 8 0.0 wikitext comb_18 llama3 rnd_affine_scale 14185.747456 15374.221312 5.207332134246826 201.409929 0.0
0.4362715482711792 5 0.0 wikitext comb_18 llama3 rnd_affine_scale 14185.747456 15374.221312 5.447094440460205 201.424086 0.0
0.4436677098274231 7 0.0 wikitext comb_18 llama3 rnd_affine_scale 14185.747456 15374.221312 5.232915878295898 201.534369 0.0
0.44140493869781494 6 0.0 wikitext comb_18 llama3 rnd_affine_scale 14185.747456 15374.221312 5.223806858062744 201.618624 0.0
0.0 4 0.0 wikitext comb_2 llama3 rnd_affine_scale 11051.945984 18748.53888 1.1352546215057373 4.377311 0.0
0.0 5 0.0 wikitext comb_2 llama3 rnd_affine_scale 11051.945984 18748.53888 1.1352546215057373 4.377311 0.0
0.0 6 0.0 wikitext comb_2 llama3 rnd_affine_scale 11051.945984 18748.53888 1.1352546215057373 4.377311 0.0
0.0 7 0.0 wikitext comb_2 llama3 rnd_affine_scale 11051.945984 18748.53888 1.1352546215057373 4.377311 0.0
0.0 8 0.0 wikitext comb_2 llama3 rnd_affine_scale 11051.945984 18748.53888 1.1352546215057373 4.377311 0.0
0.0 4 0.0 wikitext comb_8 llama3 rnd_affine_scale 11051.945984 18748.53888 inf 4.399257 0.0
0.0 5 0.0 wikitext comb_8 llama3 rnd_affine_scale 11051.945984 18748.53888 inf 4.399257 0.0
0.0 6 0.0 wikitext comb_8 llama3 rnd_affine_scale 11051.945984 18748.53888 inf 4.399257 0.0
0.0 7 0.0 wikitext comb_8 llama3 rnd_affine_scale 11051.945984 18748.53888 inf 4.399257 0.0
0.0 8 0.0 wikitext comb_8 llama3 rnd_affine_scale 11051.945984 18748.53888 inf 4.399257 0.0
0.0 4 0.0 wikitext comb_13 llama3 rnd_affine_scale 16811.959808 19811.794944 1.2315895557403564 426.954251 0.0
0.0 5 0.0 wikitext comb_13 llama3 rnd_affine_scale 16811.959808 19811.794944 1.2315895557403564 426.954251 0.0
0.0 6 0.0 wikitext comb_13 llama3 rnd_affine_scale 16811.959808 19811.794944 1.2315895557403564 426.954251 0.0
0.0 7 0.0 wikitext comb_13 llama3 rnd_affine_scale 16811.959808 19811.794944 1.2315895557403564 426.954251 0.0
0.0 8 0.0 wikitext comb_13 llama3 rnd_affine_scale 16811.959808 19811.794944 1.2315895557403564 426.954251 0.0
0.0 4 0.0 wikitext comb_0 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037375 0.0
0.0 5 0.0 wikitext comb_0 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037375 0.0
0.0 6 0.0 wikitext comb_0 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037375 0.0
0.0 7 0.0 wikitext comb_0 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037375 0.0
0.0 8 0.0 wikitext comb_0 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037375 0.0
0.0 4 0.0 wikitext comb_12 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037421 0.0
0.0 5 0.0 wikitext comb_12 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037421 0.0
0.0 6 0.0 wikitext comb_12 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037421 0.0
0.0 7 0.0 wikitext comb_12 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037421 0.0
0.0 8 0.0 wikitext comb_12 llama3 rnd_affine_scale 11051.945984 23420.993536 inf 4.037421 0.0
0.4436677098274231 32 0.0 wikitext base llama3 ---- 33003.526656 33155.97312 5.223813056945801 27.59022 0.0