Nonstandard Errors
Creators: name: Menkveld, Albert J
name: Dreber, Anna
name: Holzmeister, Felix
name: Huber, Juergen
name: Johannesson, Magnus
name: Kirchler, Michael
name: Neususs, Sebastian
name: Razen, Michael
name: Weitzel, Utz
name: Abad-Diaz, David
name: Abudy, Menachem Meni
name: Adrian, Tobias
name: Ait-Sahalia, Yacine
name: Akmansoy, Olivier
name: Alcock, Jamie T
name: Alexeev, Vitali
name: Aloosh, Arash
name: Amato, Livia
name: Amaya, Diego
name: Angel, James J
name: Avetikian, Alejandro T
name: Bach, Amadeus
name: Baidoo, Edwin
name: Bakalli, Gaetan
name: Bao, Li
name: Barbon, Andrea
name: Bashchenko, Oksana
name: Bindra, Parampreet C
name: Bjonnes, Geir H
name: Black, Jeffrey R
name: Black, Bernard S
name: Bogoev, Dimitar
name: Correa, Santiago Bohorquez
name: Bondarenko, Oleg
name: Bos, Charles S
name: Bosch-Rosa, Ciril
name: Bouri, Elie
name: Brownlees, Christian
name: Calamia, Anna
name: Viet, Nga Cao
name: Capelle-Blancard, Gunther
name: Romero, Laura M Capera
name: Caporin, Massimiliano
name: Carrion, Allen
name: Caskurlu, Tolga
name: Chakrabarty, Bidisha
name: Chen, Jian
name: Chernov, Mikhail
name: Cheung, William
name: Chincarini, Ludwig B
name: Chordia, Tarun
name: Chow, Sheung-Chi
name: Clapham, Benjamin
name: Colliard, Jean-Edouard
name: Comerton-Forde, Carole
name: Curran, Edward
name: Thong, Dao
name: Dare, Wale
name: Davies, Ryan J
name: De Blasis, Riccardo
name: De Nard, Gianluca F
name: Declerck, Fany
name: Deev, Oleg
name: Degryse, Hans
name: Deku, Solomon Y
name: Desagre, Christophe
name: Van Dijk, Mathijs A
name: Dim, Chukwuma
name: Dimpfl, Thomas
name: Dong, Yun Jiang
name: Drummond, Philip A
name: Dudda, Tom
name: Duevski, Teodor
name: Dumitrescu, Ariadna
name: Dyakov, Teodor
name: Dyhrberg, Anne Haubo
name: Dzielinski, Michal
name: Eksi, Asli
name: Kalak, Izidin El
name: Ellen, Saskia ter
name: Eugster, Nicolas
name: Evans, Martin DD
name: Farrell, Michael
name: Felez-Vinas, Ester
name: Ferrara, Gerardo
name: Ferrouhi, El Mehdi
name: Flori, Andrea
name: Fluharty-Jaidee, Jonathan T
name: Foley, Sean DV
name: Fong, Kingsley YL
name: Foucault, Thierry
name: Franus, Tatiana
name: Franzoni, Francesco
name: Frijns, Bart
name: Frommel, Michael
name: Fu, Servanna M
name: Fullbrunn, Sascha C
name: Gan, Baoqing
name: Gao, Ge
name: Gehrig, Thomas P
name: Gemayel, Roland
name: Gerritsen, Dirk
name: Gil-Bazo, Javier
name: Gilder, Dudley
name: Glosten, Lawrence R
name: Gomez, Thomas
name: Gorbenko, Arseny
name: Grammig, Joachim
name: Gregoire, Vincent
name: Gucbilmez, Ufuk
name: Hagstromer, Bjorn
name: Hambuckers, Julien
name: Hapnes, Erik
name: Harris, Jeffrey H
name: Harris, Lawrence
name: Hartmann, Simon
name: Hasse, Jean-Baptiste
name: Hautsch, Nikolaus
name: He, Xue-Zhong Tony
name: Heath, Davidson
name: Hediger, Simon
name: Hendershott, Terrence
name: Hibbert, Ann Marie
name: Hjalmarsson, Erik
name: Hoelscher, Seth A
name: Hoffmann, Peter
name: Holden, Craig W
name: Horenstein, Alex R
name: Huang, Wenqian
name: Huang, Da
name: Hurlin, Christophe
name: Ilczuk, Konrad
name: Ivashchenko, Alexey
name: Iyer, Subramanian R
name: Jahanshahloo, Hossein
name: Jalkh, Naji
name: Jones, Charles M
name: Jurkatis, Simon
name: Jylha, Petri
name: Kaeck, Andreas T
name: Kaiser, Gabriel
name: Karam, Arze
name: Karmaziene, Egle
name: Kassner, Bernhard
name: Kaustia, Markku
name: Kazak, Ekaterina
name: Kearney, Fearghal
name: Van Kervel, Vincent
name: Khan, Saad A
name: Khomyn, Marta K
name: Klein, Tony
name: Klein, Olga
name: Klos, Alexander
name: Koetter, Michael
name: Kolokolov, Aleksey
name: Korajczyk, Robert A
name: Kozhan, Roman
name: Krahnen, Jan P
name: Kuhle, Paul
name: Kwan, Amy
name: Lajaunie, Quentin
name: Lam, FY Eric C
name: Lambert, Marie
name: Langlois, Hugues
name: Lausen, Jens
name: Lauter, Tobias
name: Leippold, Markus
name: Levin, Vladimir
name: Li, Yijie
name: Li, Hui
name: Liew, Chee Yoong
name: Lindner, Thomas
name: Linton, Oliver
name: Liu, Jiacheng
name: Liu, Anqi
name: Llorente, Guillermo
name: Lof, Matthijs
name: Lohr, Ariel
name: Longstaff, Francis
name: Lopez-Lira, Alejandro
name: Mankad, Shawn
name: Mano, Nicola
name: Marchal, Alexis
name: Martineau, Charles
name: Mazzola, Francesco
name: Meloso, Debrah
name: Mi, Michael G
name: Mihet, Roxana
name: Mohan, Vijay
name: Moinas, Sophie
name: Moore, David
name: Mu, Liangyi
name: Muravyev, Dmitriy
name: Murphy, Dermot
name: Neszveda, Gabor
name: Neumeier, Christian
name: Nielsson, Ulf
name: Nimalendran, Mahendrarajah
name: Nolte, Sven
name: Norden, Lars L
name: O'Neill, Peter
name: Obaid, Khaled
name: Odegaard, Bernt A
name: Ostberg, Per
name: Pagnotta, Emiliano
name: Painter, Marcus
name: Palan, Stefan
name: Palit, Imon J
name: Park, Andreas
name: Pascual, Roberto
name: Pasquariello, Paolo
name: Pastor, Lubos
name: Patel, Vinay
name: Patton, Andrew J
name: Pearson, Neil D
name: Pelizzon, Loriana
name: Pelli, Michele
name: Pelster, Matthias
name: Perignon, Christophe
name: Pfiffer, Cameron
name: Philip, Richard
name: Plihal, Tomas
name: Prakash, Puneet
name: Press, Oliver-Alexander
name: Prodromou, Tina
name: Prokopczuk, Marcel
name: Putnins, Talis
name: Qian, Ya
name: Raizada, Gaurav
name: Rakowski, David
name: Ranaldo, Angelo
name: Regis, Luca
name: Reitz, Stefan
name: Renault, Thomas
name: Renjie, Rex W
name: Reno, Roberto
name: Riddiough, Steven J
name: Rinne, Kalle
name: Rintamaki, Paul
name: Riordan, Ryan
name: Rittmannsberger, Thomas
name: Longarela, Inaki Rodriguez
name: Roesch, Dominik
name: Rognone, Lavinia
name: Roseman, Brian
name: Rosu, Ioanid
name: Roy, Saurabh
name: Rudolf, Nicolas
name: Rush, Stephen R
name: Rzayev, Khaladdin
name: Rzeznik, Aleksandra A
name: Sanford, Anthony
name: Sankaran, Harikumar
name: Sarkar, Asani
name: Sarno, Lucio
name: Scaillet, Olivier
name: Scharnowski, Stefan
name: Schenk-Hoppe, Klaus R
name: Schertler, Andrea
name: Schneider, Michael
name: Schroeder, Florian
name: Schuerhoff, Norman
name: Schuster, Philipp
name: Schwarz, Marco A
name: Seasholes, Mark S
name: Seeger, Norman J
name: Shachar, Or
name: Shkilko, Andriy
name: Shui, Jessica
name: Sikic, Mario
name: Simion, Giorgia
name: Smales, Lee A
name: Soderlind, Paul
name: Sojli, Elvira
name: Sokolov, Konstantin
name: Sonksen, Jantje
name: Spokeviciute, Laima
name: Stefanova, Denitsa
name: Subrahmanyam, Marti G
name: Szaszi, Barnabas
name: Talavera, Oleksandr
name: Tang, Yuehua
name: Taylor, Nick
name: Tham, Wing Wah
name: Theissen, Erik
name: Thimme, Julian
name: Tonks, Ian
name: Tran, Hai
name: Trapin, Luca
name: Trolle, Anders B
name: Vaduva, M Andreea
name: Valente, Giorgio
name: Van Ness, Robert A
name: Vasquez, Aurelio
name: Verousis, Thanos
name: Verwijmeren, Patrick
name: Vilhelmsson, Anders
name: Vilkov, Grigory
name: Vladimirov, Vladimir
name: Vogel, Sebastian
name: Voigt, Stefan
name: Wagner, Wolf
name: Walther, Thomas
name: Weiss, Patrick
name: Van der Wel, Michel
name: Werner, Ingrid M
name: Westerholm, P Joakim
name: Westheide, Christian
name: Wika, Hans C
name: Wipplinger, Evert
name: Wolf, Michael
name: Wolff, Christian CP
name: Wolk, Leonard
name: Wong, Wing-Keung
name: Wrampelmeyer, Jan
name: Wu, Zhen-Xing
name: Xia, Shuo
name: Xiu, Dacheng
name: Xu, Ke
name: Xu, Caihong
name: Yadav, Pradeep K
name: Yague, Jose
name: Yan, Cheng
name: Yang, Antti
name: Yoo, Woongsun
name: Yu, Wenjia
name: Yu, Yihe
name: Yu, Shihao
name: Yueshen, Bart Z
name: Yuferova, Darya
name: Zamojski, Marcin
name: Zareei, Abalfazl
name: Zeisberger, Stefan M
name: Zhang, Lu
name: Zhang, S Sarah
name: Zhang, Xiaoyu
name: Zhao, Lu
name: Zhong, Zhuo
name: Zhou, Z Ivy
name: Zhou, Chen
name: Zhu, Xingyu S
name: Zoican, Marius
name: Zwinkels, Remco
Publisher: name: La Trobe
Year: 2024
Subjects: classificationCode: 38
subject: Economics
classificationCode: 4905
subject: Statistics
subject: FOS: Mathematics
classificationCode: 3502
subject: Banking, finance and investment
classificationCode: 3801
subject: Applied economics

description: In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty—nonstandard errors (NSEs). We study NSEs by letting 164 teams test the same hypotheses on the same data. NSEs turn out to be sizable, but smaller for more reproducible or higher rated research. Adding peer-review stages reduces NSEs. We further find that this type of uncertainty is underestimated by participants.