Open Research Publishing: enabling more holistic reporting and evaluation of research Rebecca Lawrence, PhD Managing Director, F1000 Group rebecca.Lawrence@f1000.com FlOOO
Challenges with existing publishing system
l  Much research is not accessible – behind paywalls l  Long delays in sharing new findings l  Biases and conflicts in anonymous editorial decisions I  Lack of data supporting the findings → hard to verify & reuse I Much good research never published → skews our understanding l  Significant research waste Open Research aims to:  increase research quality, boost collaboration, speed up the research process, make the assessment of research more transparent, and promote public access to scientific results Fl 88 Knowledge Unlatched THE CONVERSATIO protocols.
Main barriers to uptake of Open Research
l  Currently researchers typically judged by Impact Factor/journal brand of research articles l  Impact Factors/brands ingrained in the assessment and evaluation system l  Impact Factors/brands very simple/easy to use – any replacement will naturally be more complex so no incentive to shift without being pushed BUT, now moved on from print, no need for journals: l  readers don't need them to find articles – search PubMed, Google Scholar, Scopus etc l  only authors need them for the reflected benefit they provide via their brand Fl 88 © 2000-2018 Faculty of 1000 Ltd
Key is to separate publication from evaluation l Research be openly accessible ; text and data mineable I Researchers be able to share all research findings – whether groundbreaking, confirmatory, null/negative, incremental etc I Research community be able to access & view new discoveries without delay l  Data underpinning findings be FAIR to support verification and reuse I  Peer reviewers receive due credit for their contribution to scholarly discourse l New discoveries judged according to its intrinsic value and NOT by the proxy of where it is published
F1888
(2000-2018 Faculty of 1000 Ltd
F1000Research: Preprints + Journal-like model
Submission and preprint-like stage Open Access Data Deposition Article Submission Broad range of article types: Data accessible Attention & usage metrics available Formal invited peer review Indexing in bibliographic databases Article Revision Open Peer Review & User Commenting Review status: Approved Approved with reservations Not approved Research Articles Data Notes Software Tools Methods Articles Systematic Reviews etc -2018 Faculty of 1000 Ltd
σ Gates Open Research ↑ SUBMIT YOUR RESEARCH BROWSE GATEWAY S HOW TO PUBLISH  ◇ ABOUTヘMY ACCOUNT ヘSIGN IN ( ) Chock for updates oli METRICS research article revised) Developing new health technologies for neglected diseases: a pipeline portfolio review and cost model[version 2; referees: 3 approved] 4392 © VIEWS Ruth Young ￼ 1 , Tewodros Bekele ￼ 1 , Alexander Gunn ￼ 1 , Nick Chapman ￼ 2 ,
Vipul Chowdhary 2 , Kelsey Corrigan 3 , Lindsay Dahora ￼ 4 , Sebastián Martinez 2 , Sallie Perman 4.7 , Johan Persson 8, Bill Rodriguez 8, Marco Schäferhoff 9, Kevin Schulman   9. AN SE Tulika Singh* H Author det Abstrac 18.5 34 53 om 2009-2015, other than Background; tes is a lack of information a brief injectio Deyn to tac on product ca ipeline, and the likelihood of specific lau Methods: We ndidates for 35 neglected diseases. Using an adapted version of the Portfolio to Impact financial modelling tool, we estimated the costs to move these candidates through the pipeline over the next decade and the likely launches. Since the current pipeline is unlikely to yield several critical products, we essimated the costs to develop a set of priority "missing" products. PD. Get XML 66 Clic [ 5] Expon (5) Track 123 Emol Floo
■ Westen 1 ■ Referee Report 10 Jul 2018 Mikel Derdad, Office of Health Economics, London, UK
 Jorge Mestre-Ferrandiz, Indopendent Consultant, London, UK ? Approved with Reservations , entitled Developing not () the function The research aricle by Young and colleagues.
neglected diseases: a pipeline portfolio review.
move products – currently at development ator   nch for each for NTDs of greatest need. Resulting from adding up that 18 g figure of $4.5B-$5.8B(yea $1.5B $2.8E If is an origin Developmen of a new of Ite RAD I global R&D Gavin Yames
Many thanks indeed to Mikal Berdud and Jorge Mestre-Ferrandiz for this very helpful review.  In the revised Micel Berdud and Jorge Nestre-Ferrandiz's seer review report lists 11 substantive comments, and curr Research is stea div, 111 addronal which dise l atter is onl i. Missing literature on assumptions: the referees kindly pave us addisonal examples of studes that
frielly discuss these addisonal papers in the Discussion section, specifi and Hay et a In geoeral, candidates officia. Con v2). Adaptati This is ab challenged could, at le ts that are missing in g in our estimate; the references
 are missing (),e, basic researc k the referees argue, and we agree, that we ahould be more
 basic research, drug discovery, and the costs of regulatory regulatory.

 ind markating submission). We have now espand the sub-heading 'Limitasions of the P2I modelling tool.' We would also refer readers to the companion page.
(reference 12 in our pager) and the criginal 2016 TOR report (ref on the modal's development Opportunity costs: as recommended by the referees, we now mention opportunity costs, apain in the in the 4ª paragraph under the sub-heading "Limitations of the P21 modelling tool We have list previous w I. The source of the data for the assumptions in Table 2: The referees note that P2Lv2 uses a range of data sources as shown in Table 2 and suppost that we give more explanation of how the different sources affected the assumptions, specifically for unprecedented vaccines. We now give more explanation in the revised paper.
 We now also discuss—under the Limitions section of the Discussi Reviewers: ↑ get credit for contributing to discussion 21. Schwarzkopf S: Referee report for: Brain-to-brain (mind-to-mind) interaction at distance: a confirmatory study [v2; ref status: approved 1, not approved 1, http://f1000r.es/4en]. F1000Res. 2014; 3: 182. Publisher Full Text →  focus on helping authors improve their work →  good training for ECRs In the revised Discussion, we state "A fifth limitation relates to the modifications that we made to the P2i'v.1 tool to create P2i'v2. As deacribed in the li © 2000-2018 Faculty of 1000 Ltd Get PDI
EDIT YOUR RECORD ABOUT ORCID CONTACT US HELP 1,978,320 ORCID IDs and Mitchell Bekritsky ORCID ID @orcid.org/000-0003-1420-1172
✔ Peer review (1) ift Print view O Country United Kingdom 0 ❤ review activity for F1000Research(1) Journal, F1000Research (2.tisms
F188 © 2000-2018 Faculty of 1000 Ltd
Funder-/institution-controlled platforms
✔ Internationalトップ8月・政治ビシネス
スポーツMr. Bill · Gates, led the world by literature publication Who is the thesis? Net - IT JsY Science & New 2018/10/6 6: 30 | Nhon Kelcal Shimburi elec III朝行will H H H H Conta 2017 when the ids of reasarchers and published the pr oft foundar, USA Inビル・ゲイツ氏、論文公開で世界主導論文は誰のものかネット・IT   IoT  科学&新技術2018/10/6 6:30 |日本経済新聞 竜子版＠保存    共有その他▼ 「迅速性、透明性のある出版物です」。学術論文を公開する英文サイト「ゲイツオーチ」を開くと、こんなうたい文句が目に入る。運営するのは米マイクロソフト創業者のビル・ゲイツ夫妻による「ビル&メリンタ・ゲイツ財団」。サイトを開設した2017年に数百人の研究者を助成し、その論文をサイトで公開している。論文をたた載せるのではない。学術誌を発行する出版社の「専売特許」だったはずの論文の評価機能も… © 2000-2018 Faculty of 1000 Ltd
Breadth of topics
Gates Open Research ▲ SUBMIT YOUR RESEARCH ABOUT × BROWSE
Modelling credit and savings behaviour of chit fund participants [version 1; referees: 1 approved, 1 approved with reservations]漫画 Prosthi Rao (@), Straton Butess
Gates Open Research
submit your research BROWSE 403 ▷ VEW 48 DOWALOAD Gates Open Research K Rogers 3. Christapher J. Davey @ ↑ SUBMIT YOUR RESEARCH ABOUT > Check for update ili
42 () DOWNLOADS ulty of 1000 Ltd BROWSE ↑ SUBMIT YOUR RESEARCH HOW TO PUBLISH  V AROUTシRESEARCH ARTICLE (evisto) Developing new health technologies for neglected diseases: a pipeline portfolio review and cost model [version 2; referees: 3 approved] Gates Open Research Ruth Yaun; ® 1 . Tewedros Vipul Chowdhary", Kalsay (
Salia Parmar), Johan Pa Tulika Singh'. 10 . Robert F ↑ SUBMIT YOUR RESEARCH ABOUT × HOW TO PUBLISH  V ence Improving energy efficiency of electrochemical blackwater disinfection through sequential reduction of suspended solids and chemical oxygen demand [version 2; referees: 2 approved]
RESEARCH ARTICLE BMSD Heterogeneous exposure and hotspots for malaria vectors at three study sites in Uganda [version 2; referees: 2 approved] 200 Su Yun Kang 😍 ¹, Katherine E. Battle 😍 ¹, Hassy S. Citson ¹, Laura V. Cooperati Kilama Marwell', Noses Kamya', Steven W. Lindsay', Grant Dorsey', Bryon Greenhouse', 
Isabel Rodriguez-Barraquer', Robert C. J. Relear', Daul L. Smith B'', Donal Bisancio',
52 COMILOADS oli Gates Open Research ili ( R ) Check for updates HOW TO PUBLISH  ◇ ABOUT × BROWSE GATEVIAY S HOW TO PUBLISH ヘ
Open Research Central (ORC) : l  Open source repository l  For all research outputs published according to set of principles for open research ll  Directed by ORC Board comprising research funders and stakeholders l  Not-for-profit organisation EMBL MEDIATE PLEI ICATION | OPEN DATA © 2000-2018 Faculty of 1000 Ltd Flood
Range of outputs and associated metrics

RESEARCH ARTICLE       EDIT VERSION A reanalysis of mouse ENCODE compa expression data [version 1; referees: 3 approved with reservations] 198 Yoav Gilad, Orna Mizrahi-Man Data availability All data are available from the Mouse ENCODE consortium; see Table S1 for specific source URLs and accession numbers. Software availability We provide supplementary files of the python codes used to process and prepare the data for analysis with R, and the data fles for the python codes. We also provide the R codes we used to perform the different analyses as supplementary files, as well as the input for the R codes Archived software files as at the time of publication Zenodo. Data files and codes used in the reanalysis of the mouse encode comparative gene expression data. DOI 10,5281/zenodo,17606 License These codes are provided under the MIT license Open Peer Review
Rafael Irizarry, Harvard School of Public Health, USA Michael Elsen, University of California, Berkeley, USA 3 Mick Watson, University of Edinburgh, UK Llor Pachter, University of California, Berkeley, USA All reports (4), Responses and comments (1) Comments on this article All comments (33) Add a Comment © 2000-2018 Faculty of 1000 Ltd
F1088 © 2000-2018 Faculty of 1000 Ltd
F1000Prime – article-based expert assessment
l  Over 8000 experts across biology and medicine l  Faculty include 10 Nobel Laureates, 16 Lasker Award winners, >150 NAS members, etc l  >200,000 recommendations, across >4000 journals l  Now adding Physics and other fields F188
F1000Prime ICLE FEDOMMENDATIONS roop racuses reloc F1000 FACULTY Manabu Fujimoto Department of Dermatology, Faculty of Me University of Tsukuba Tsukuba, Iberaki日  Polk 20 Contac FECOMMENDATIONS BOSRAFHT ACADEMIC POGITION: Professor and Chair, Department of Dermatology. Faculty of Medicine, University of Tsukubu EDUCATION: MD, University of Tokyo (1992) RESEARCH INTERESTS: • Scleroderma • Dermatomyositis • Alsoimmunity • B cell biology
1908年9月CURSENT POSITION fice Department Head, Department of Motor Control and Retabilitation, ATR Computational Neuroscience Laboratories -2018 Faculty of 1000 Ltd F188
Example recommendations
FXOOPrime andators  © Hypoxia fate mapping identifies cycling cardiomyocytes in the adult heart. on DC  Musicher S    The: S    Zhang Hit    Abdu si William R in Y   Changi   Garcia JA   Shebon M Inform JA    Adhey Ad    Adathanky A    Lieng H    Xing C    Lu Z    Zheng CO    ...1 mon   - in the adult heart. 90 xxx' ca lena DC' Master 2' Roders'manY' CharlA' Carde A'' Shelton M' Roder on / 115 ARGERAM' ALSINARGYA' LEAGH' DIGC' LEAR' DIAGOO' Rada Ha Va tent of Internal Modeleus, Disings of Confederation
deen Medical Creder, Dalen, Team, 2008), 182 T Lib Science Conce, Tackaba Advanced Proceech Afternot, University
Terroratist, Terroratist, Instances 2016/05/21, Japan . HON Fores Heath Caro Septem, 4009 Soch Lan "Occortnont of Moderic, 14 Solid
Rood, Outler, Senan 1921s, Life Occertnont of Microfter Biology, the inversity of Texac I
 Baina, Yokas YSINA USA Occessors of Patrolsgs. I he University
Touca 258X0, ESA F1000Prime Armena sex commonouricans ・・・ Q, Servi O Incidence and outcomes of repositioning surgery to correct misalignment of toric intraocular lenses. on M    Inster Y     Chapti Y     Inster Y     Forte Y     Myete K      Melano R Incidence and outcomes of repositioning surgery to correct misalignment of toric intraceular lenses. [ 2010/04] Menin K ´    Nebano 89 ² inous Eyo Clinic, Glayama, Japan * Chachi Eps Clinic, Holdcaldo, Japan 1 Sugin Ere Clair, Takyo, * Prille Ise Cluic, Tokashiran, Jap * Myaza Ent Hooping, Myazaki, Moan aca of cysmalenings Pyapasis xanakar i ingenal transit, signar F188 The authors of 00 rasa sartes practics data of a nary bugh s Faculty of 1000 Ela iratians relevant to their reacarch Hypoxia fate mapping identifies cycling cardiomyocyt
l  Badges to capture level of checks (e.g. plagiarism, reporting) and of review (e.g. expert peer review, community review) l  Expert recommendations (e.g. F1000Prime, PreLights, PreReview, Research Highlights) l  Journals & societies could move from publishing new findings to providing curation across all published findings (not just what is sent to them) Flood
Summary
l  The tools and technologies exist to resolve many issues with the traditional way of communicating new discoveries ● Little will change unless we tackle the rewards & incentives structure head-on l  We no longer need the journal; researchers should be able to communicate new findings when they are ready l  New models exist and have been thoroughly tested to enable a better way of communicating research l  Publishers should shift from gatekeepers to service providers to the scientific community l  Research funders, governments and institutions are crucial to embracing and enabling researchers to change to such a system
rebecca.lawrence@f1000.com FIOCO © 2000-2018 Faculty of 1000 Ltd