title: Non-Standard Errors
Creators: name: Menkfeld, Albert J.
name: Dreber, Anna
name: Holzmeister, Felix
name: Huber, Juergen
name: Johannesson, Magnus
name: Kirchler, Michael
name: Neusüss, Sebastian
name: Razen, Michael
name: Weitzel, Utz
name: Abad-Díaz, David
name: Abudy, Menachem
name: Adrian, Tobias
name: Ait-Sahalia, Yacine
name: Akmansoy, Olivier
name: Alcock, Jamie T.
name: Alexeev, Vitali
name: Aloosh, Arash
name: Amato, Livia
name: Amaya, Diego
name: Angel, James J.
name: Avetikian, Alejandro T.
name: Bach, Amadeus
name: Baidoo, Edwin
name: Bakalli, Gaetan
name: Bao, Li
name: Barbon, Andrea
name: Bashchenko, Oksana
name: Bindra, Parampreet C.
name: Bjønnes, Geir H.
name: Black, Jeffrey R.
name: Black, Bernard S.
name: Bogoev, Dimitar
name: Bohorquez Correa, Santiago
name: Bondarenko, Oleg
name: Bos, Charles S.
name: Bosch-Rosa, Ciril
name: Bouri, Elie
name: Brownlees, Christian
name: Calamia, Anna
name: Cao, Viet Nga
name: Capelle-Blancard, Gunther
name: Capera Romero, Laura M.
name: Caporin, Massimiliano
name: Carrion, Allen
name: Caskurlu, Tolga
name: Chakrabarty, Bidisha
name: Chen, Jian
name: Chernov, Mikhail
name: Cheung, William
name: Chincarini, Ludwig B.
name: Chordia, Tarun
name: Chow, Sheung-Chi
name: Clapham, Benjamin
name: Colliard, Jean-Edouard
name: Comerton-Forde, Carole
name: Curran, Edward
name: Dao, Thong
name: Dare, Wale
name: Davies, Ryan J.
name: De Blasis, Riccardo
name: De Nard, Gianluca F.
name: Declerck, Fany
name: Deev, Oleg
name: Degryse, Hans
name: Deku, Solomon Y.
name: Desagre, Christophe
name: van Dijk, Mathijs A.
name: Dim, Chukwuma
name: Dimpfl, Thomas
name: Dong, Yun Jiang
name: Drummond, Philip A.
name: Dudda, Tom
name: Duevski, Teodor
name: Dumitrescu, Ariadna
name: Dyakov, Teodor
name: Dyhrberg, Anne Haubo
name: Dzielinski, Michał
name: Eksi, Asli
name: El Kalak, Izidin
name: ter Ellen, Saskia
name: Eugster, Nicolas
name: Evans, Martin D. D.
name: Farrell, Michael
name: Felez-Vinas, Ester
name: Ferrara, Gerardo
name: Ferrouhi, El Mehdi
name: Flori, Andrea
name: Fluharty, Jonathan T.
name: Foley, Sean D. V.
name: Fong, Kingsley Y. L.
name: Foucault, Thierry
name: Franus, Tatiana
name: Franzoni, Francesco
name: Frijns, Bart
name: Frömmel, Michael
name: Fu, Servanna M.
name: Füllbrunn, Sascha C.
name: Gan, Baoqing
name: Gao, Ge
name: Gehrig, Thomas P.
name: Gemayel, Roland
name: Gerritsen, Dirk
name: Gil-Bazo, Javier
name: Gilder, Dudley
name: Glosten, Lawrence R.
name: Gomez, Thomas
name: Gorbenko, Arseny
name: Grammig, Joachim
name: Grégoire, Vincent
name: Güçbilmez, Ufuk
name: Hagströmer, Björn
name: Hambuckers, Julien
name: Hapnes, Erik
name: Harris, Jeffrey H.
name: Harris, Lawrence
name: Hartmann, Simon
name: Hasse, Jean-Baptiste
name: Hautsch, Nikolaus
name: He, Xue-Zhong (Tony)
name: Heath, Davidson
name: Hediger, Simon
name: Hendershott, Terrence
name: Hibbert, Ann Marie
name: Hjalmarsson, Erik
name: Hoelscher, Seth
name: Hoffmann, Peter
name: Holden, Craig W.
name: Horenstein, Alex R.
name: Huang, Wenqian
name: Huang, Da
name: Hurlin, Christophe
name: Ilczuk, Konrad
name: Ivashchenko, Alexey
name: Iyer, Subramanian R.
name: Jahanshahloo, Hossein
name: Jalkh, Naji P.
name: Jones, Charles M.
name: Jurkatis, Simon
name: Jylhä, Petri
name: Kaeck, Andreas T.
name: Kaiser, Gabriel
name: Karam, Arzé
name: Karmaziene, Egle
name: Kassner, Bernhard
name: Kaustia, Markku
name: Kazak, Ekaterina
name: Kearney, Fearghal
name: Kervel, Vincent van
name: Khan, Saad A.
name: Khomyn, Marta K.
name: Klein, Tony
name: Klein, Olga
name: Klos, Alexander
name: Koetter, Michael
name: Kolokolov, Aleksey
name: Korajczyk, Robert A.
name: Kozhan, Roman
name: Krahnen, Jan P.
name: Kuhle, Paul
name: Kwan, Amy
name: Lajaunie, Quentin
name: Lam, F. Y. Eric C.
name: Lambert, Marie
name: Langlois, Hugues
name: Lausen, Jens
name: Lauter, Tobias
name: Leippold, Markus
name: Levin, Vladimir
name: Li, Yijie
name: Li, Hui
name: Liew, Chee Yoong
name: Lindner, Thomas
name: Linton, Oliver
name: Liu, Jiacheng
name: Liu, Anqi
name: Llorente, Guillermo
name: Lof, Matthijs
name: Lohr, Ariel
name: Longstaff, Francis
name: Lopez-Lira, Alejandro
name: Mankad, Shawn
name: Mano, Nicola
name: Marchal, Alexis
name: Martineau, Charles
name: Mazzola, Francesco
name: Meloso, Debrah
name: Mi, Michael G.
name: Mihet, Roxana
name: Mohan, Vijay
name: Moinas, Sophie
name: Moore, David
name: Mu, Liangyi
name: Muravyev, Dmitriy
name: Murphy, Dermot
name: Neszveda, Gabor
name: Neumeier, Christian
name: Nielsson, Ulf
name: Nimalendran, Mahendrarajah
name: Nolte, Sven
name: Norden, Lars L.
name: O'Neill, Peter W.
name: Obaid, Khaled
name: Ødegaard, Bernt A.
name: Östberg, Per
name: Pagnotta, Emiliano
name: Painter, Marcus
name: Palan, Stefan
name: Palit, Imon J.
name: Park, Andreas
name: Pascual, Roberto
name: Pasquariello, Paolo
name: Pastor, Lubos
name: Patel, Vinay
name: Patton, Andrew J.
name: Pearson, Neil D.
name: Pelizzon, Loriana
name: Pelli, Michele
name: Pelster, Matthias
name: Pérignon, Christophe
name: Pfiffer, Cameron
name: Philip, Richard
name: Plíhal, Tomáš
name: Prakash, Puneet
name: Press, Oliver-Alexander
name: Prodromou, Tina
name: Prokopczuk, Marcel
name: Putnins, Talis
name: Qian, Ya
name: Raizada, Gaurav
name: Rakowski, David
name: Ranaldo, Angelo
name: Regis, Luca
name: Reitz, Stefan
name: Renault, Thomas
name: Renjie, Rex W.
name: Reno, Roberto
name: Riddiough, Steven J.
name: Rinne, Kalle
name: Rintamäki, Paul J.
name: Riordan, Ryan
name: Rittmannsberger, Thomas
name: Rodríguez Longarela, Iñaki
name: Roesch, Dominik
name: Rognone, Lavinia
name: Roseman, Brian
name: Rosu, Ioanid
name: Roy, Saurabh
name: Rudolf, Nicolas
name: Rush, Stephen R.
name: Rzayev, Khaladdin
name: Rzeznik, Aleksandra A.
name: Sanford, Anthony
name: Sankaran, Harikumar
name: Sarkar, Asani
name: Sarno, Lucio
name: Scaillet, Olivier
name: Scharnowski, Stefan
name: Schenk-Hoppé, Klaus R.
name: Schertler, Andrea
name: Schneider, Michael
name: Schroeder, Florian
name: Schürhoff, Norman
name: Schuster, Philipp
name: Schwarz, Marco A.
name: Seasholes, Mark S.
name: Seeger, Norman J.
name: Shachar, Or
name: Shkilko, Andriy
name: Shui, Jessica
name: Sikic, Mario
name: Simion, Giorgia
name: Smales, Lee A.
name: Söderlind, Paul
name: Sojli, Elvira
name: Sokolov, Konstantin
name: Sönksen, Jantje
name: Spokeviciute, Laima
name: Stefanova, Denitsa
name: Subrahmanyam, Marti G.
name: Szaszi, Barnabas
name: Talavera, Oleksandr
name: Tang, Yuehua
name: Taylor, Nick
name: Tham, Wing Wah
name: Theissen, Erik
name: Thimme, Julian
name: Tonks, Ian
name: Tran, Hai
name: Trapin, Luca
name: Trolle, Anders B.
name: Vaduva, M. Andreea
name: Valente, Giorgio
name: Van Ness, Robert A.
name: Vasquez, Aurelio
name: Verousis, Thanos
name: Verwijmeren, Patrick
name: Vilhelmsson, Anders
name: Vilkov, Grigory
name: Vladimirov, Vladimir
name: Vogel, Sebastian
name: Voigt, Stefan
name: Wagner, Wolf
name: Walther, Thomas
name: Weiss, Patrick
name: van der Wel, Michel
name: Werner, Ingrid M.
name: Westerholm, Joakim
name: Westheide, Christian
name: Wika, Hans C.
name: Wipplinger, Evert
name: Wolf, Michael
name: Wolff, Christian C. P.
name: Wolk, Leonard
name: Wong, Wink-Keung
name: Wrampelmeyer, Jan
name: Wu, Zhen-Xing
name: Xia, Shuo
name: Xiu, Dacheng
name: Xu, Ke
name: Xu, Caihong
name: Yadav, Pradeep K.
name: Yagüe, José
name: Yan, Cheng
name: Yang, Antti
name: Yoo, Woongsun
name: Yu, Wenjia
name: Yu, Yihe
name: Yu, Shihao
name: Yueshen, Bart Z.
name: Yuferova, Darya
name: Zamojski, Marcin
name: Zareei, Abalfazl
name: Zeisberger, Stefan M.
name: Zhang, Lu
name: Zhang, S. Sarah
name: Zhang, Xiaoyu
name: Zhao, Lu
name: Zhong, Zhuo
name: Zhou, Zeyang (Ivy)
name: Zhou, Chen
name: Zhu, Xingyu S.
name: Zoican, Marius
name: Zwinkels, Remco
Publisher: name: Universitätsbibliothek der Ludwig-Maximilians-Universität München
Year: 2023

description: In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty: Non-standard errors (NSEs). We study NSEs by letting 164 teams test the same hypotheses on the same data. NSEs turn out to be sizable, but smaller for better reproducible or higher rated research. Adding peer-review stages reduces NSEs. We further find that this type of uncertainty is underestimated by participants.