an Economist Intelligence Unit business healthcare About us Services Benefits Case Studies Resources Contact search Bazian presents a poster on the quality of reporting in systematic reviews August 29th 2014 At Bazian we spend a large amount of time appraising and reporting on the quality of healthcare research. In addition to the various tools available to help appraise the quality of published research, there are a number of reporting standards that aim to encourage better quality reporting. Transparent reporting of methodologies and findings facilitate quality assessment and replication to test research findings. Based on a hunch, one of our Information Specialists - Elly O’Brien - decided to undertake some research into how well journals that endorse the PRISMA reporting standards for systematic reviews actually adhere to those guidelines. This preliminary research was presented as a poster at The Chartered Institute of Library and Information Professionals Health Libraries Group conference in Oxford earlier this year. The research involved analysing a random sample of issues within a sample of freely available PRISMA journals. A total of 23 articles were analysed. Encouragingly, compliance was generally good, with an average of 67% of the criteria being met. Some key findings of the research were: All of the systematic reviews clearly stated their objectives. 87% described themselves as a systematic review in the article title. 70% of the systematic reviews reported assessing the quality of the studies included in the review, but many did not report the tool used and 12% of the studies did not report the results of the quality assessment in the main paper. Searches were reported in varying detail, 91% of systematic reviews reported the databases they searched, but only 22% reported their full search strategy. 83% of systematic reviews reported the process for selecting studies and only 74% reported the methods for data extraction. The source of funding was reported in 39% of systematic reviews. Only 13% of systematic reviews reported assessing bias across studies, such as publication bias. The main conclusions of the research were: Improved reporting of studies would improve fellow researchers’ ability to reproduce or build upon research, judge potential sources of bias and assess methodological quality—especially where there may be a discrepancy between the methods used and what was reported. Improved reporting would reduce the effort spent in devising, validating and using search filters to identify systematic reviews in bibliographic databases. It would also allow greater auto-indexing in bibliographic databases, which would improve the reliability and consistency of built-in search filters, and make database records available more quickly. See the PDF version of Elly’s poster here. About us Our team Publications EBM & evidology Testimonials Work with us Cookie policy News Bazian are recruiting Bazian presents a poster on the quality of reporting in systematic reviews EIU breakfast events in August and September Bazian are recruiting! NICE Evidence Updates: latest news New NICE Evidence Update Published EIU Healthcare publishes second VBH paper NICE Evidence Update on Epilepsy Value-based healthcare: the new normal Royal College of Surgeons and Surgical Specialty Associations publish commissioning guidance Bazian are recruiting Royal College of Surgeons and Surgical Specialty Associations commissioning guidance process accredited by NICE Bazian are recruiting Bazian are now part of the EIU Bazian are recruiting Tadaaa! Launch of the Bazian Evidence Portal We are appsolutely thrilled to announce the launch of our first iPad app! Bazian supports development of NICE’s clinical guidelines New Evidence Updates on… First anniversary of working with NHS Evidence Another Evidence Update published… New addition to the Bazian team Four new Evidence Updates A new Evidence Update published Norovirus report completed for the European Centre for Disease prevention and Control Say hello, wave goodbye New Evidence Update published Evidence Update published Hope and hype: stem cells in the media The Food Hospital A sober analysis of alcohol and health in the media Bazian are recruiting Bazian influences FDA recommendations on the communication of risk (sort of) Alzheimer’s in the news Bazian’s Dr Alexandra McAleenan features in the C3 newsletter 2000th Behind the Headlines story Supporting the Royal Statistical Society's ten-year statistical literacy campaign. New faces and a fond farewell Supplements: Who needs them? East Midlands Right Care Musculoskeletal and Pain Management “Planning Lab” Bazian wins tender to support NICE; as a key supplier to NHS Evidence Another new Information Specialist! Behind the Headlines on the BBC! New Information Specialists Renal replacement therapy service planning model Bazian are recruiting, again! Miracle foods: myth and the media Bazian are recruiting Quality Assurance of Australian NHMRC Guidelines Chemotherapy at home Fit for purpose: centralised updating support for high priority Cochrane Reviews Helping commissioners predict the cost of new biologic drugs Should Science Journalists take sides? Bazian’s breakfast GIN Celebrating BtH at the RCS Bad science or bad science reporting The Commissioning Support Appraisals Service (CSAS) "Balance" in science journalism Who will help GPs commission? NHS Choices “saves £44m a year” Support for PCTs in NICE Appraisals Bazian's updated guideline for Royal College Bazian's involvement with Health England latest launch... Bazian are recruiting ADHD aetiology review New people Bazian's Swine Flu tracker tools Bazian added to PASA-CEP framework Brian Haynes on Behind The Headlines Bazian and Choices win BMJ Innovation Award Helping Health England prioritise effective interventions New case study: Water fluoridation in Southampton Anna Donald has died Bazian added to NICE framework Behind The Headlines in the Guardian Health England report now available Bazian welcomes new clients Bazian co-founder blogging for BMJ © 2015 Bazian | The Economist Intelligence Unit | Sitemap | Site by Redwire