Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Filter by Categories
15th National Conference of the IAOMFP, Chennai, 2006
Abstract
Abstracts from current literature
Acne in India: Guidelines for management - IAA Consensus Document
Addendum
Announcement
Art & Psychiatry
Article
Articles
Association Activities
Association Notes
Award Article
Book Review
Brief Report
Case Analysis
Case Letter
Case Letters
Case Notes
Case Report
Case Reports
Clinical and Laboratory Investigations
Clinical Article
Clinical Studies
Clinical Study
Commentary
Conference Oration
Conference Summary
Continuing Medical Education
Correspondence
Corrigendum
Cosmetic Dermatology
Cosmetology
Current Best Evidence
Current Issue
Current View
Derma Quest
Dermato Surgery
Dermatopathology
Dermatosurgery Specials
Dispensing Pearl
Do you know?
Drug Dialogues
e-IJDVL
Editor Speaks
Editorial
Editorial Remarks
Editorial Report
Editorial Report - 2007
Editorial report for 2004-2005
Errata
Erratum
Focus
Fourth All India Conference Programme
From Our Book Shelf
From the Desk of Chief Editor
General
Get Set for Net
Get set for the net
Guest Article
Guest Editorial
History
How I Manage?
IADVL Announcement
IADVL Announcements
IJDVL Awards
IJDVL AWARDS 2015
IJDVL Awards 2018
IJDVL Awards 2019
IJDVL Awards 2020
IJDVL International Awards 2018
Images in Clinical Practice
In Memorium
Inaugural Address
Index
Knowledge From World Contemporaries
Leprosy Section
Letter in Response to Previous Publication
Letter to Editor
Letter to the Editor
Letter to the Editor - Case Letter
Letter to the Editor - Letter in Response to Published Article
LETTER TO THE EDITOR - LETTERS IN RESPONSE TO PUBLISHED ARTICLES
Letter to the Editor - Observation Letter
Letter to the Editor - Study Letter
Letter to the Editor - Therapy Letter
Letter to the Editor: Articles in Response to Previously Published Articles
Letters in Response to Previous Publication
Letters to the Editor
Letters to the Editor - Letter in Response to Previously Published Articles
Letters to the Editor: Case Letters
Letters to the Editor: Letters in Response to Previously Published Articles
Medicolegal Window
Messages
Miscellaneous Letter
Musings
Net Case
Net case report
Net Image
Net Letter
Net Quiz
Net Study
New Preparations
News
News & Views
Obituary
Observation Letter
Observation Letters
Oration
Original Article
ORIGINAL CONTRIBUTION
Original Contributions
Pattern of Skin Diseases
Pearls
Pediatric Dermatology
Pediatric Rounds
Perspective
Presedential Address
Presidential Address
Presidents Remarks
Quiz
Recommendations
Regret
Report
Report of chief editor
Report of Hon : Treasurer IADVL
Report of Hon. General Secretary IADVL
Research Methdology
Research Methodology
Resident page
Resident's Page
Resident’s Page
Residents' Corner
Residents' Corner
Residents' Page
Retraction
Review
Review Article
Review Articles
Revision Corner
Self Assessment Programme
SEMINAR
Seminar: Chronic Arsenicosis in India
Seminar: HIV Infection
Short Communication
Short Communications
Short Report
Snippets
Special Article
Specialty Interface
Studies
Study Letter
Study Letters
Supplement-Photoprotection
Supplement-Psoriasis
Symposium - Contact Dermatitis
Symposium - Lasers
Symposium - Pediatric Dermatoses
Symposium - Psoriasis
Symposium - Vesicobullous Disorders
SYMPOSIUM - VITILIGO
Symposium Aesthetic Surgery
Symposium Dermatopathology
Symposium-Hair Disorders
Symposium-Nails Part I
Symposium-Nails-Part II
Systematic Reviews and Meta-analyses
Systematic Reviews and Meta-analysis
Tables
Technology
Therapeutic Guideline-IADVL
Therapeutic Guidelines
Therapeutic Guidelines - IADVL
Therapeutics
Therapy
Therapy Letter
View Point
Viewpoint
What’s new in Dermatology
View/Download PDF

Translate this page into:

Editorial
88 (
4
); 447-449
doi:
10.25259/IJDVL_564_2022
pmid:
35841588

Research waste is universal

Editor-in-Chief, Indian Journal of Dermatology, Venereology & Leprology, University of Nottingham, Nottingham, UK
Centre of Evidence Based Dermatology, University of Nottingham, Nottingham, UK
Corresponding Author: Dr. Saumya Panda, Consultant Dermatologist, Belle Vue Clinic, Kolkata, 700028, West Bengal, India, ijdvleditor@gmail.com
Licence
This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-Share Alike 4.0 License, which allows others to remix, transform, and build upon the work non-commercially, as long as the author is credited and the new creations are licensed under the identical terms.

How to cite this article: Panda S, Williams HC. Research waste is universal. Indian J Dermatol Venereol Leprol 2022;88:447-9.

What is research waste?

Research waste refers to avoidable design flaws, non-publication and inadequate reporting of research. It includes research undertaken without any form of prioritization, research that duplicates previous research unnecessarily, does not assess important outcomes, and is limited by significant biases that could have been overcome by better planning. In other words, it is poor quality research that is not needed and introduces “noise” rather than reducing uncertainties that are needed for patient care.

Contrary to previous assumptions ascribing this phenomenon to a few (or, a lot of) bad apples, it is wiser to acknowledge it as a universal problem, stemming from multisystem failure, the contours of which were systematically outlined by Chalmers and Glasziou in 2009.1 As one of us (H.C.W.) has delineated recently, clinical dermatological research is no exception as far as research waste is concerned.2

Why should it concern us?

This problem of research waste has particularly pernicious implications for a developing country like India. Taking note of the paucity of funds for clinical dermatological research, the Indian Association of Dermatologists, Venereologists & Leprologists (IADVL) started providing research grants since 2013 on the basis of calls for applications by the IADVL Academy. Let us take a look at the outcome of the IADVL research grants over the years: Out of the 28 projects completed up to December 2021, only 16 have been published. The fate of the IADVL L’Oreal grants, which were initiated in 2010, is hardly any better: Out of 54 completed projects, 35 have been published. Granted that some of the projects are in the publication pipeline, the figure of around 60% of completed projects getting published can hardly be a cause of comfort.

What may be the reason for such worrying numbers for research in India? As someone (S.P.) who has been actively adjudicating these research grants almost for a decade now, the major problems that one has noticed regarding the proposals are: inadequate design; lack of formal estimation of sample size so that one does not have any idea whether the studies have the necessary power to reach valid conclusion; and, finally, lack of clinical relevance so that the studies do not get a high priority for publication in peer-reviewed journals.

Not a very happy picture. Research waste is an undesirable problem wherever it happens, but if and when it plagues a country like India with meagre resources for research, alarm bells should start ringing.

Factors behind research waste

Factors behind accumulation of research waste have been generally identified as lack of prioritization by researchers and funders, use of unvalidated outcome measures,3 duplication of studies (e.g., multiple placebo-controlled studies instead of comparing with an established active agent,)4, unnecessary proliferation of systematic reviews and meta-analyses (earning them the unflattering sobriquet of ‘sausage machines’5), poor design (in interventional studies, no allocation concealment, no intention-to-treat analysis etc), lack of publication of negative studies leading to publication bias, lack of enforcement of prospective trial registration by journals and regulatory bodies leading to selective reporting outcome bias,6 and the use of spin that distorts the interpretation of results.7

If we analyze these factors, it is clear that all stakeholders hold responsibility for these failings: untrained or poorly trained researchers; funders failing to properly identify priority areas of research; the wrong approach of academic bodies to reward quantity rather than quality leading to a culture of ‘publish or perish’ and emergence of a section of authors displaying publication addiction8; journals failing to root out inadequate scientific reporting; commercial interests vitiating research; and, lack of capability of research users or readers to critically appraise clinical research.

How to minimize research waste

Researchers must make a habit of taking stock of existing research before rushing headlong into undertaking new research. High-quality systematic reviews (e.g., Cochrane reviews) or guidelines are a useful source for identifying research gaps, supplemented by updated searches of bibliographic databases and trial registers.9

Just identifying a workable clinical research question is not enough–the results need to be of value to a range of stakeholders including patients and healthcare providers, in our context primarily the Indian dermatological patients and Indian dermatologists. Methods on how to work effectively with a range of stakeholders to identify and prioritize research questions have been developed over the last two decades through organizations such as the James Lind Alliance (JLA). The Alliance produces a guidebook and provides help on how to set up a priority setting partnership (PSP), gathering and verifying uncertainties, and how to prioritize the final ‘top ten’ topics.9

Funders can also play a more active role in prioritizing research rather than working solely in response mode. For example, the National Institute for Health Research Health Technology Assessment (NIHR HTA) Programme in the United Kingdom (UK) actively identifies and prioritizes clinical research questions that need answering. It then invites teams to apply in open competition to deliver such commissioning briefs.9 Research funders in India, like the IADVL Academy or the newly founded Society for Eczema Studies (SES), could adopt similar commissioned approaches for funding priority topics.

Outcomes in clinical studies need to measure something important to patients, and need to be reliable, valid, sensitive to change and clinically interpretable. Core sets of valid and reliable outcomes that should be used in all clinical trials on a particular skin disease are needed so that studies can be compared and combined. The pioneering work of the Harmonising Outcome Measures for Eczema (HOME) group has been instrumental in this regard.10 Over 20 other groups are working on developing core outcome sets in diverse dermatological conditions such as skin cancer and incontinence-associated dermatitis, using up-to-date methods supported by the Cochrane Skin Core Outcomes Set Initiative.9 Senior Indian researchers–faculty in the academic departments who train would-be researchers and the principal investigators of studies and trials–need embrace such initiatives and incorporate these core outcomes in the studies they design.

Working with methodologists and biostatisticians is key to minimizing bias at the design stage. The Dermatology Clinical Research Special Interest Group (SIG DCR) of the IADVL Academy is providing invaluable resource in this regard since 2013, but more is needed. Understanding basic methods and knowing how to critically appraise a clinical study that could benefit patients is a core competency for clinical dermatologists, every bit as important and as fundamental as learning how to make a clinical diagnosis, how to evaluate a basic histopathology slide or how to remove a viral wart. Unfortunately, this is still not being done satisfactorily in many postgraduate departments in our country. Better training - of the trainers as well as the trainees - is needed.

The easiest way to minimize publication bias is to make it mandatory for studies such as clinical trials to have pre-registered protocols. This journal made it a compulsory requirement for interventional studies as early as in 2017. Every clinical trial submitted in the Indian Journal of Dermatology, Venereology & Leprology (IJDVL) from that time onwards had to have a Clinical Trials Registry–India (CTRI) registration number (or, registered to similar registries elsewhere in case of overseas authors). At the same time, IJDVL made the submission of the Consolidated Standards of Reporting Trials (CONSORT) checklist and flow diagram mandatory for clinical trials. It may sound bureaucratic, but the principle is simple: “Place your bet and show us your hand”.11 Since last year, when the IJDVL opened a new article category of ‘systematic reviews and meta-analyses’, being overwhelmed by the huge number of submissions such articles, it made compliance to the 27-item Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist mandatory and prospective registration of the protocol a desirable criterion. To the best of our knowledge, among the Indian dermatology journals, the Indian Journal of Dermatology (IJD) also has pre-registration of clinical trials and compliance to CONSORT as mandatory criteria for submission. But here the impediment to quality control is, once again, the quantity - this time, of journals. Latest figures indicate that the total number of dermatology journals in India is 22 and worldwide it is over 300. It is now almost impossible not to be able to publish any data, however poor quality, error-ridden, opaque or misleading it be. In order to obviate publication bias, IADVL and the Academy may take a leaf out of the NIHR HTA Programme, making it a contracting requirement for projects to be withheld a certain proportion of the grant funds until full online publication of the reports is completed within a reasonable time frame after completion of the project in peer-reviewed journals of repute.

Conclusion

The purpose of this editorial is to raise awareness about the universality of research waste in dermatology clinical research—a phenomenon that is not only the concern of advanced research societies, but perhaps even more so to the wider clinical dermatology community, where there is palpable lack of systemic encouragement of research, clinical research in particular. Any waste in such resource-poor settings is particularly unconscionable. All the stakeholders—researchers, institutions, funders, journals and research users - need to actively engage in simple measures to reduce research waste. The problem is reversible, and we have indicated a certain road map for solving it. Sometimes, less is more — perhaps, most tellingly, in contemporary dermatology clinical research, where less quantity and better quality and relevance might make it more impactful for our patients and for our society.

Acknowledgement

We acknowledge the contribution of Dr Deepika Pandhi, ex-Chairperson of the IADVL Academy and Section Editor, IJDVL, for the data regarding the IADVL Research Grant projects.

References

  1. , . Avoidable waste in the production and reporting of research evidence. Lancet. 2009;374:86-9.
    [CrossRef] [PubMed] [Google Scholar]
  2. . Avoidable research waste in dermatology: What is the problem? Br J Dermatol. 2022;186:383-5.
    [CrossRef] [Google Scholar]
  3. , , , , , , et al. Cochrane Skin Core Outcome Set Initiative. Cochrane reviews and dermatological trials outcome concordance: Why core outcome sets could make trial results more usable. J Invest Dermatol. 2019;139:1045-53.
    [CrossRef] [PubMed] [Google Scholar]
  4. , . Research waste in atopic eczema trials – just the tip of the iceberg. J Invest Dermatol. 2016;136:1930-3.
    [CrossRef] [PubMed] [Google Scholar]
  5. . Are dermatology systematic reviews spinning out of control? Dermatology. 2021;237:493-5.
    [CrossRef] [Google Scholar]
  6. , , , . Prospective registration and outcome-reporting bias in randomized controlled trials of eczema treatments: A systematic review. J Invest Dermatol. 2012;132:2727-34.
    [CrossRef] [PubMed] [Google Scholar]
  7. , , , , , , et al. Analysis of spin in the reporting of studies of topical treatments of photoaged skin. J Am Acad Dermatol. 2019;80:516-22.
    [CrossRef] [PubMed] [Google Scholar]
  8. . Publishing addiction: A behavioural disorder with specific characteristics. Br J Dermatol. 2021;184:338-9.
    [CrossRef] [Google Scholar]
  9. . Avoidable research waste in dermatology: What are the solutions? Br J Dermatol. 2022;186:599-601.
    [CrossRef] [Google Scholar]
  10. , , , , , , et al. HOME Initiative. The HOME Core outcome set for clinical trials of atopic dermatitis. J Allergy Clin Immunol. 2022;149:1899-1911.
    [CrossRef] [PubMed] [Google Scholar]
  11. , . Clinical Trials Submitted to the JID: Place Your Bet and Show Us Your Hand. J Invest Dermatol. 2015;135:325-7.
    [CrossRef] [PubMed] [Google Scholar]
Show Sections