|
<!DOCTYPE html> |
|
<html> |
|
<head> |
|
<meta charset="utf-8" /> |
|
<meta name="viewport" content="width=device-width" /> |
|
<title> MindBigData Leaderboard</title> |
|
<link rel="stylesheet" href="style.css" /> |
|
</head> |
|
<body> |
|
<head> |
|
<style type="text/css"> |
|
.auto-style1 { |
|
border-left: 1px solid #C0C0C0; |
|
border-top: 1px solid #C0C0C0; |
|
font-size: large; |
|
text-align: center; |
|
border-right-style: solid; |
|
border-right-width: 1px; |
|
border-bottom-style: solid; |
|
border-bottom-width: 1px; |
|
} |
|
.auto-style2 { |
|
text-align: center; |
|
} |
|
.auto-style3 { |
|
border-width: 0; |
|
} |
|
.auto-style4 { |
|
border-left: 1px solid #C0C0C0; |
|
border-top: 1px solid #C0C0C0; |
|
text-align: center; |
|
border-right-style: solid; |
|
border-right-width: 1px; |
|
border-bottom-style: solid; |
|
border-bottom-width: 1px; |
|
} |
|
.auto-style5 { |
|
border-left: 1px solid #C0C0C0; |
|
border-top: 1px solid #C0C0C0; |
|
text-align: center; |
|
border-right-style: solid; |
|
border-right-width: 1px; |
|
border-bottom-style: solid; |
|
border-bottom-width: 1px; |
|
color: #FF0000; |
|
} |
|
.auto-style6 { |
|
font-size: x-large; |
|
} |
|
</style> |
|
</head> |
|
|
|
<div style="text-align:center"> |
|
<h1 id="space-title">🌟 MindBigData Leaderboard 🌟</h1> |
|
</div> |
|
<div class="auto-style2"> |
|
📐 The 🤗 Open MindBigData Leaderboard aims to track, rank and evaluate |
|
Brain EEG models related to the papers:<br> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022" target="_blank"> |
|
📝MindBigData 2022 A Large Dataset of Brain Signals</a> and |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2023_MNIST-8B" target="_blank"> |
|
📝MindBigData2023_MNIST-8B </a> <br>🚀 Submit a model or paper in the |
|
community tab<br></div> |
|
|
|
<strong><span class="auto-style6">Multiclass prediction:</span></strong> |
|
|
|
<table style="width: 100%" class="auto-style3"> |
|
<tr> |
|
<td class="auto-style1" style="width: 149px"><strong>Accuracy</strong></td> |
|
<td class="auto-style1" style="width: 239px"><strong>Model</strong></td> |
|
<td class="auto-style1" style="width: 459px"><strong>DataSet</strong></td> |
|
<td class="auto-style1" style="width: 495px"><strong>Who?</strong></td> |
|
<td class="auto-style1" style="width: 228px"><strong>Paper</strong></td> |
|
<td class="auto-style1"><strong>Code</strong></td> |
|
</tr> |
|
<tr> |
|
<td class="auto-style4" style="width: 149px"><strong>🔥98.97%</strong> *<br> |
|
<strong>🔥89.62%</strong> **</td> |
|
<td class="auto-style4" style="width: 239px">BrainDigiCNN</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_EP" target="_blank"> |
|
MindBigData2022_MNIST_EP</a> [3Gb] *<br> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_IN" target="_blank">MindBigData2022_MNIST_IN</a> [201Mb] **</td> |
|
<td class="auto-style4" style="width: 495px">Smita Tiwari, Shivani Goel and Arpit Bhardwaj </td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://link.springer.com/article/10.1007/s13369-022-07313-3" target="_blank"> |
|
abs</a> 🔒 2023</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px"><strong>96.18%</strong> *<br>71.60% ** (at least Muse results are disputed due to i-reproducibility of results atm, authors please clarify to Dr. Lisa-Marie Vortmann to validate and peer review)</td> |
|
<td class="auto-style4" style="width: 239px">RNN</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_MU" target="_blank">MindBigData2022_MNIST_MU</a> [289Mb] |
|
*<br> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_EP" target="_blank"> |
|
MindBigData2022_MNIST_EP</a> [3Gb] **</td> |
|
<td class="auto-style4" style="width: 495px">Nrushingh Charan Mahapatra and Prachet Bhuyan</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://iopscience.iop.org/article/10.1088/1741-2552/acc976/meta" target="_blank"> |
|
abs</a> 🔒 2023</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">95.4%</td> |
|
<td class="auto-style4" style="width: 239px">CNN-GAN</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_EP" target="_blank"> |
|
MindBigData2022_MNIST_EP</a> [3Gb]</td> |
|
<td class="auto-style4" style="width: 495px">Nastaran Khaleghi, |
|
Shaghayegh Hashemi, Sevda Zafarmandi Ardabili, Sobhan |
|
Sheykhivand and Sebelan Danishvar</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10708586/pdf/sensors-23-09351.pdf" target="_blank"> |
|
pdf</a> 2023</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
<tr> |
|
<td style="width: 149px" class="auto-style4">91.29%</td> |
|
<td style="width: 239px" class="auto-style4">CNN</td> |
|
<td style="width: 459px" class="auto-style4"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_IN" target="_blank">MindBigData2022_MNIST_IN</a> [201Mb] </td> |
|
<td style="width: 495px" class="auto-style4">Nandini Kumari, Shamama Anwar and Vandana Bhattacharjee </td> |
|
<td style="width: 228px" class="auto-style4"> |
|
<a href="https://link.springer.com/chapter/10.1007/978-981-16-1543-6_22" target="_blank"> |
|
book</a> 🔒 2021</td> |
|
<td style="height: 22px" class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
|
|
|
|
<tr> |
|
<td style="width: 149px" class="auto-style4">claimed 88% but results are disputed, thanks to the code review by Dr. Lisa-Marie Vortmann and corroborated by David Vivancos the labels is not the digit but the channel number</td> |
|
<td style="width: 239px" class="auto-style4">R-CNN</td> |
|
<td style="width: 459px" class="auto-style4"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_MU" target="_blank">MindBigData2022_MNIST_MU</a> [289Mb]</td> |
|
<td style="width: 495px" class="auto-style4">Andrew Perez</td> |
|
<td style="width: 228px" class="auto-style4"> |
|
<a href="https://colab.research.google.com/drive/1q1mvIC1xgEuPNNvgASrAG7zie3qRjr-8" target="_blank"> |
|
colab</a> 2023</td> |
|
<td style="height: 22px" class="auto-style4">yes |
|
<span style="color: rgb(77, 81, 86); font-family: "Google Sans", arial, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; white-space: normal; background-color: rgb(255, 255, 255); text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;"> |
|
👏 thaks for sharing code but please review your claims</span></td> |
|
</tr> |
|
|
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px"><strong>🔥86%</strong></td> |
|
<td class="auto-style4" style="width: 239px">CNN</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_VisMNIST_Cap64" target="_blank"> |
|
MindBigData2022_VisMNIST_Cap64</a> [544Mb] </td> |
|
<td class="auto-style4" style="width: 495px"> Salvatore Falciglia, Filippo Betello, Samuele Russo, Christian Napoli</td> |
|
<td style="width: 228px" class="auto-style4"> |
|
<a href="https://www.sciencedirect.com/science/article/pii/S0925231224004259" target="_blank"> |
|
pdf</a> 2024</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
|
|
<tr> |
|
<td style="width: 149px" class="auto-style4"><strong>🔥85%</strong></td> |
|
<td style="width: 239px" class="auto-style4">CNN</td> |
|
<td style="width: 459px" class="auto-style4"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_Imagenet_IN_Spct" target="_blank"> |
|
MindBigData2022_Imagenet_IN_Spct</a> [3Gb] 📷</td> |
|
<td style="width: 495px" class="auto-style4">Matthew Zhang and Jeremy Lu</td> |
|
<td style="width: 228px" class="auto-style4"> |
|
<a href="https://www.jsr.org/hs/index.php/path/article/view/4178/2028" target="_blank"> |
|
pdf</a> 2024</td> |
|
<td style="height: 22px" class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">75%</td> |
|
<td class="auto-style4" style="width: 239px">CNN</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_IN" target="_blank"> |
|
MindBigData2022_Imagenet_IN</a> [201Mb]📷</td> |
|
<td class="auto-style4" style="width: 495px"> |
|
Adolfo Ramirez-Aristizabal</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://medium.com/@adolfo.ramirezz/brain-2-image-reverse-engineering-visual-perception-from-brain-signals-5dddf8fdbb4b" target="_blank"> |
|
medium</a> 2023</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px"><strong>🔥73.54%</strong> *<br>72.91% **<br> |
|
72.39% ***<br></td> |
|
<td class="auto-style4" style="width: 239px">CNN* <br>LSTM** <br>DNN***</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_IN" target="_blank"> |
|
MindBigData2022_Imagenet_IN</a> [201Mb]📷</td> |
|
<td class="auto-style4" style="width: 495px">Saumya Kushwaha, Priyanka Jain and N. K. Jain</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://scholar.google.com/scholar?oi=bibs&hl=en&cluster=4679500355112375870" target="_blank"> |
|
book</a> 🔒 2023</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">70%</td> |
|
<td class="auto-style4" style="width: 239px">CNN</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_EP" target="_blank"> |
|
MindBigData2022_MNIST_EP</a> [3Gb]</td> |
|
<td class="auto-style4" style="width: 495px">Rahul Mishra, Krishan Sharma, Arnav Bhavsar</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://eurasip.org/Proceedings/Eusipco/Eusipco2021/pdfs/0001226.pdf" target="_blank"> |
|
pdf</a> 2021</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
|
|
<tr> |
|
<td style="width: 149px" class="auto-style4">31.35%</td> |
|
<td style="width: 239px" class="auto-style4">A. B. DEvo MLP</td> |
|
<td style="width: 459px" class="auto-style4"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_MU" target="_blank">MindBigData2022_MNIST_MU</a> [289Mb]</td> |
|
<td style="width: 495px" class="auto-style4"> Jordan J. Bird, Diego R. Faria, Luis J. Manso, Anikó Ekárt, Christopher D. Buckingham</td> |
|
<td style="width: 228px" class="auto-style4"> |
|
<a href="https://downloads.hindawi.com/journals/complexity/2019/4316548.pdf" target="_blank"> |
|
pdf</a> 2019</td> |
|
<td style="height: 22px" class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">27.9%</td> |
|
<td class="auto-style4" style="width: 239px">REEGNet</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_IN" target="_blank"> |
|
MindBigData2022_Imagenet_IN</a> [201Mb]📷</td> |
|
<td class="auto-style4" style="width: 495px">Khushiyant, | Mathur, Vidhu | Kumar, Sandeep | Shokeen, Vikrant</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://content.iospress.com/articles/intelligent-decision-technologies/idt230715" target="_blank"> |
|
abs</a> 🔒 2024</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">22,42%</td> |
|
<td class="auto-style4" style="width: 239px">EEGNeX</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_EP" target="_blank"> |
|
MindBigData2022_MNIST_EP</a> [3Gb]</td> |
|
<td class="auto-style4" style="width: 495px">Hang Du</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://yorkspace.library.yorku.ca/items/6d77a52e-6dfc-40f7-852f-96ddb09c777b" target="_blank"> |
|
pdf</a> 2023</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">19.42% *<br>17.72% **</td> |
|
<td class="auto-style4" style="width: 239px">Transformer</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_EP" target="_blank"> |
|
MindBigData2022_MNIST_EP</a> [3Gb] * |
|
<br> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_MU" target="_blank">MindBigData2022_MNIST_MU</a> [289Mb] ** |
|
</td> |
|
<td class="auto-style4" style="width: 495px">Omkar Muglikar</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://keep.lib.asu.edu/system/files/c7/Muglikar_asu_0010N_21413.pdf" target="_blank"> |
|
pdf</a> 2021</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
|
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">16,69%</td> |
|
<td class="auto-style4" style="width: 239px">EEGNet-8,2</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_EP" target="_blank"> |
|
MindBigData2022_MNIST_EP</a> [3Gb]</td> |
|
<td class="auto-style4" style="width: 495px">Xia Chen, Xiangbin Teng, Han Chen, Yafeng Pan and Philipp Geyer</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://arxiv.org/pdf/2207.12369.pdf" target="_blank"> |
|
pdf</a> 2023</td> |
|
<td class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">10%</td> |
|
<td class="auto-style4" style="width: 239px">cnn?</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2023_MNIST-8B" target="_blank"> |
|
MindBigData2023_MNIST-8B</a> [52Gb]🧠+🎶</td> |
|
<td class="auto-style4" style="width: 495px"> Caelen Hilty and Zander Chown</td> |
|
<td class="auto-style4" style="width: 228px"><a href="https://medium.com/@caelenhilty/mindnist-29f6fdda948d" target="_blank"> |
|
medium</a> 2024</td> |
|
<td class="auto-style4"><a href="https://github.com/zchown/MindMnist-8BClassification" target="_blank"> |
|
yes</a> 👏 </td> |
|
</tr> |
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">???</td> |
|
<td class="auto-style4" style="width: 239px">????</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2023_MNIST-2B" target="_blank"> |
|
MindBigData2023_MNIST-2B</a> [14Gb]🧠+🎶</td> |
|
<td class="auto-style5" style="width: 495px"> no entries yet > Submit |
|
your model</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
???</td> |
|
<td class="auto-style4">???</td> |
|
|
|
</tr> |
|
<tr> |
|
<td class="auto-style4" style="width: 149px">???</td> |
|
<td class="auto-style4" style="width: 239px">????</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_VisMNIST_Cap64_Morlet" target="_blank"> |
|
MindBigData2022_VisMNIST_Cap64_Morlet</a> [2Gb] 📷</td> |
|
<td class="auto-style5" style="width: 495px"> no entries yet > Submit |
|
your model</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
???</td> |
|
<td class="auto-style4">???</td> |
|
</tr> |
|
|
|
|
|
|
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">???</td> |
|
<td class="auto-style4" style="width: 239px">????</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_VisMNIST_MU2" target="_blank"> |
|
MindBigData2022_VisMNIST_MU2</a> [3Gb]</td> |
|
<td class="auto-style5" style="width: 495px"> no entries yet > Submit |
|
your model</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
???</td> |
|
<td class="auto-style4">???</td> |
|
</tr> |
|
|
|
<tr> |
|
<td class="auto-style4" style="width: 149px">???</td> |
|
<td class="auto-style4" style="width: 239px">????</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_MW" target="_blank"> |
|
MindBigData2022_MNIST_MW</a> [217Mb] </td> |
|
<td class="auto-style5" style="width: 495px"> no entries yet > Submit |
|
your model</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
???</td> |
|
<td class="auto-style4">???</td> |
|
</tr> |
|
|
|
|
|
</table> |
|
|
|
|
|
|
|
<strong><span class="auto-style6"><br>Binary prediction:</span></strong> |
|
|
|
<table style="width: 100%" class="auto-style3"> |
|
<tr> |
|
<td class="auto-style1" style="width: 149px"><strong>Accuracy</strong></td> |
|
<td class="auto-style1" style="width: 239px"><strong>Model</strong></td> |
|
<td class="auto-style1" style="width: 459px"><strong>DataSet</strong></td> |
|
<td class="auto-style1" style="width: 495px"><strong>Who?</strong></td> |
|
<td class="auto-style1" style="width: 228px"><strong>Paper</strong></td> |
|
<td class="auto-style1"><strong>Code</strong></td> |
|
</tr> |
|
<tr> |
|
<td class="auto-style4" style="width: 149px"><strong>🔥95%</strong> <br> |
|
</td> |
|
<td class="auto-style4" style="width: 239px">CNN</td> |
|
<td class="auto-style4" style="width: 459px"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_MU" target="_blank">MindBigData2022_MNIST_MU</a> |
|
[289Mb] |
|
</td> |
|
<td class="auto-style4" style="width: 495px">Diganta Kalita |
|
</td> |
|
<td class="auto-style4" style="width: 228px"> |
|
<a href="https://dxganta.medium.com/decoding-thoughts-with-deep-learning-eeg-based-digit-detection-using-cnns-cdf7eee20722" target="_blank"> |
|
medium </a> 2023</td> |
|
<td class="auto-style4">yes |
|
<span style="color: rgb(77, 81, 86); font-family: "Google Sans", arial, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; white-space: normal; background-color: rgb(255, 255, 255); text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;"> |
|
👏 </span></td> |
|
</tr> |
|
|
|
<tr> |
|
<td style="width: 149px" class="auto-style4">85%</td> |
|
<td style="width: 239px" class="auto-style4">LSTM</td> |
|
<td style="width: 459px" class="auto-style4"> |
|
<a href="https://huggingface.co/datasets/DavidVivancos/MindBigData2022_MNIST_MU" target="_blank">MindBigData2022_MNIST_MU</a> [289Mb]</td> |
|
<td style="width: 495px" class="auto-style4">Pablo Martín Puerto</td> |
|
<td style="width: 228px" class="auto-style4"> |
|
<a href="https://idus.us.es/bitstream/handle/11441/147273/G4486_Mart%C3%ADn%20Puerto.pdf" target="_blank"> |
|
pdf [SP]</a> 2023</td> |
|
<td style="height: 22px" class="auto-style4">n/a</td> |
|
</tr> |
|
|
|
|
|
</table> |
|
|
|
|
|
</body> |
|
</html> |
|
|
|
|
