Think Beyond Research Outcome and Publication! A Review of Various Parameters for Assessment of Medical Research
DOI:
https://doi.org/10.55489/njcm.161020255623Keywords:
Assessment, Bibliometrics, Data sharing, Equator network, Impact factor, LMIC research, Peer review, Research QualityAbstract
Medical research has following phases- planning, performance, documentation, analysis, and publication. Evaluation of research can be summative (i.e. evaluations of research results) vs formative (i.e. evaluation used for improving scientific processes), quantitative vs qualitative and individual vs institute/departments. Understanding the usefulness and impact of science is important; Peer review mechanisms for objectively processing protocols should be there to produce quality research. Research committees should be established at the institute level to monitor the progress of research. Publication of research findings in high-quality international and peer-reviewed scientific journals should be emphasized apart from using the research for patient care, policy and programs. For improved decision-making in biomedical research, evaluation should be based on both bibliometric methods and peer review. For capacity building and skills development in research, researchers involved in the biomedical field require rigorous and methodological training to appraise the quality of evidence available critically and not trust all published literature. This narrative review aims to synthesize parameters for assessing medical research quality beyond outcomes and publications, focusing on LMICs like India. This review is narrative and non-systematic, subjective in nature and potentially subject to selection bias.
References
Herrmann-Lingen C, Brunner E, Hildenbrand S, Loew TH, Raupach T, Spies C, Treede RD, Vahl CF, Wenz HJ. Evaluation of medical research performance--position paper of the Association of the Scientific Medical Societies in Germany (AWMF). Ger Med Sci. 2014 Jun 26;12:Doc11. DOI: https://doi.org/10.3205/000196. PMID: 24971044; PMCID: PMC4071625.
ESHRE Capri Workshop Group. Protect us from poor-quality medical research. Hum Reprod. 2018;33(5):770-776. DOI: https://doi.org/10.1093/humrep/dey056 PMid:29617882
Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gülmezoglu AM, Howells DW, Ioannidis JP, Oliver S. How to increase value and reduce waste when research priorities are set. Lancet. 2014 Jan 11;383(9912):156-165. DOI: https://doi.org/10.1016/S0140-6736(13)62229-1. PMID: 24411644.
Peng L, Li J, Chu Y, Song H, Sun K, Sun J, Fan J, Yan C, Yuan H. A Comprehensive Bibliometric Analysis of Biomedical Research Waste: Current Situation, Development, and Trends. Med Sci Monit. 2025 Jun 27;31:e948390. DOI: https://doi.org/10.12659/MSM.948390 PMID: 40574270; PMCID: PMC12211405
Röhrig B, du Prel JB, Blettner M. Study design in medical research: part 2 of a series on the evaluation of scientific publications. Dtsch Arztebl Int. 2009 Mar;106(11):184-9. DOI: https://doi.org/10.3238/arztebl.2009.0184 PMID: 19568374; PMCID: PMC2695375
Madhan M, Gunasekaran S, Arunachalam S. Evaluation of research in India - are we doing it right? Indian J Med Ethics. 2018 Jul-Sep;3(3):221-229. DOI: https://doi.org/10.20529/IJME.2018.024 PMID: 29650499.
Salluh JIF, Arabi YM, Binnie A. COVID-19 research in critical care: the good, the bad, and the ugly. Intensive Care Med. 2021;47(4):470-472. DOI: https://doi.org/10.1007/s00134-021-06367-5 PMid:33646318 PMCid:PMC7917526
Grundeis F, Ansems K, Dahms K, Thieme V, Metzendorf MI, Skoetz N, Benstoem C, Mikolajewska A, Griesel M, Fichtner F, Stegemann M. Remdesivir for the treatment of COVID-19. Cochrane Database Syst Rev. 2023 Jan 25;1(1):CD014962. DOI: https://doi.org/10.1002/14651858.CD014962.pub2 PMID: 36695483 PMCID: PMC9875553
Satyanarayana K. Journal evaluation: why and how? Indian J Gastroenterol. 1993 Apr;12 Suppl 1:S5-8. PMID: 8325673.
Satyanarayana K, Sharma A. Biomedical Journals in India: some critical concerns. Indian J Med Res. 2010 Aug;132:119-122. PMID: 20716810.
Draft framework for accreditation and ranking of colleges regulated by national medical commission (released may 10, 2025). Available at https://www.legalitysimplified.com/wp-content/uploads/2025/05/Draft-framework-for-accreditation-and-ranking-of-Medical-Colleges-regulated-by-MARB-NMC.pdf
Singh T, Gupta P. Can we consider scholarship of teaching learning rather than focusing only on publications for recognition of medical teachers by National Medical Commission? Ann Natl Acad Med Sci (India). 2021;57(1):1-2. DOI: https://doi.org/10.1055/s-0041-1722822
Grudniewicz A, Moher D, Cobey KD, et al. Predatory journals: no definition, no defence. Nature. 2019;576(7786):210-212. DOI: https://doi.org/10.1038/d41586-019-03759-y PMid:31827288
Tolani MA, Ahmed M, Ojewola RW, et al. Assessment of health-care research and its challenges among medical doctors in Nigeria. Niger Med J. 2020;61(4):218-222. DOI: https://doi.org/10.4103/nmj.NMJ_46_20 PMid:33284869 PMCid:PMC7688027
Department of Health Research, Ministry of Health and Family Welfare, Government of India. National health research policy. New Delhi: The Department; 2011. Available from: https://cdn.who.int/media/docs/default-source/searo/research-and-innovation/india-national-health-research-policy-2011.pdf.
Central Drugs Standard Control Organization. New Drugs and Clinical Trials Rules, 2019. New Delhi: Ministry of Health and Family Welfare; 2019. Available from: https://cdsco.gov.in/opencms/resources/UploadCDSCOWeb/2022/new_DC_rules/NEW%20DRUGS%20ANDctrS%20RULE,%202019.pdf.
Moher D, Collins G, Hoffmann T, Glasziou P, Ravaud P, Bian Z et al. Reporting on data sharing: executive position of the EQUATOR Network BMJ 2024;386:e079694. DOI: https://doi.org/10.1136/bmj-2024-079694 PMid:39137944 PMCid:PMC11320295
Resnik DB, Hosseini M. The ethics of using artificial intelligence in scientific research: new guidance needed for a new tool. AI Ethics. 2025 Apr;5(2):1499-1521. DOI: https://doi.org/10.1007/s43681-024-00493-8 PMid:40337745 PMCid:PMC12057767
Pai SA. Medical journals - in the news and for the wrong reasons. Indian J Med Ethics. 2014;11(1):7-9. DOI: https://doi.org/10.20529/IJME.2014.003 PMid:24509101
Committee on Publication Ethics. Joint consensus conference on misconduct in biomedical research: consensus statement. London: COPE; 2000. Available from: https://www.tnsroindia.org.in/pdfs/scroll/2023/COPE%20Guidelines.pdf.
University Grants Commission. UGC regulations on minimum qualifications for appointment of teachers and other academic staff in universities and colleges and measures for the maintenance of standards in higher education, 2018. New Delhi: UGC; 2018. Available from: https://nluo.ac.in/storage/2024/05/UGC-Regulations-2018-for-appointment-of-teachers-and-academic-staff.pdf.
National Medical Commission. Teachers eligibility qualifications in medical institutions regulations, 2022. New Delhi: NMC; 2022. Available from: https://thc.nic.in/Central%20Governmental%20Regulations/Teachers%20Eligibility%20Qualifications%20in%20Medical%20Institutions%20%20Regulations,2022.pdf.
National Medical Commission. Teachers eligibility qualifications in medical institutions regulations, 2025. New Delhi: NMC; 2025. Available from: https://www.nmc.org.in/MCIRest/open/getDocument?path=/Documents/Public/Portal/LatestNews/264399.pdf
Omar M, Sorin V, Collins JD, Reich D, Freeman R, Gavin N, Charney A, Stump L, Bragazzi NL, Nadkarni GN, Klang E. Multi-model assurance analysis showing large language models are highly vulnerable to adversarial hallucination attacks during clinical decision support. Commun Med (Lond). 2025 Aug 2;5(1):330. DOI: https://doi.org/10.1038/s43856-025-01021-3 PMid:40753316 PMCid:PMC12318031
Elali FR, Rachid LN. AI-generated research paper fabrication and plagiarism in the scientific community. Patterns (N Y). 2023 Mar 10;4(3):100706. DOI: https://doi.org/10.1016/j.patter.2023.100706 PMid:36960451 PMCid:PMC10028415
Beall J. Criteria for determining predatory open-access publishers. 3rd ed. Scholarly Open Access; 2015. Available from: https://beallslist.weebly.com/uploads/3/0/9/5/30958339/criteria-2015.pdf.
Butler D. Investigating journals: the dark side of publishing. Nature. 2013;495(7442):433-435. DOI: https://doi.org/10.1038/495433a PMid:23538810
Laine C, Winker MA. Identifying predatory or pseudo-journals. Biochem Med (Zagreb). 2017;27(2):285-291. DOI: https://doi.org/10.11613/BM.2017.031 PMid:28694720 PMCid:PMC5493175
Seethapathy GS, Santhosh Kumar JU, Hareesha AS. India's scientific publication in predatory journals: need for regulating quality of Indian science and education. Curr Sci. 2016;111(11):1759-1764. DOI: https://doi.org/10.18520/cs/v111/i11/1759-1764
Beall's List of Potential Predatory Journals and Publishers. Update available from: https://beallslist.net/#update. Last updated December 24, 2024. [Accessed on August 31, 2025]
Pisanski K. Predatory journals recruit fake editor. Nature. 2017;543(7646):481-483. DOI: https://doi.org/10.1038/543481a PMid:28332542
Principles of Transparency and Best Practice in Scholarly Publishing. Available from: https://wame.org/principles-of-transparency-and-best-practice-in-scholarly-publishing [Accessed on August 31, 2025]
Elmore SA, Weston EH. Predatory journals: what they are and how to avoid them. Toxicol Pathol. 2020;48(4):607-610. DOI: https://doi.org/10.1177/0192623320920209 PMid:32319351 PMCid:PMC7237319
Think Check Submit. Available from: http://thinkchecksubmit.org/ [Accessed on September 1, 2025]
Alt A. The evolution of predatory Journals - New strategies and threats. A letter to the editor. European Journal of Physiotherapy, 2025:1–3. DOI: https://doi.org/10.1080/21679169.2025.2537442
Christine Laine, Dianne Babski, Vivienne C. Bachelet, et al. Predatory Journals: What Can We Do to Protect Their Prey?. Ann Intern Med.2025;178:294-296. DOI: https://doi.org/10.7326/ANNALS-24-03636 PMid:39761575
Aggarwal R, Gogtay N, Kumar R, Sahni P; Indian Association of Medical Journal Editors. The revised guidelines of the Medical Council of India for academic promotions: need for a rethink. Indian J Med Ethics. 2016;1(1):2-5. DOI: https://doi.org/10.20529/IJME.2016.001
Moher D, Glasziou P, Chalmers I, et al. Increasing value and reducing waste in biomedical research: who's listening? Lancet. 2016;387(10027):1573-1586. DOI: https://doi.org/10.1016/S0140-6736(15)00307-4 PMid:26423180
Jefferson T, Rudin M, Brodney Folse S, Davidoff F. Editorial peer review for improving the quality of reports of biomedical studies. Cochrane Database Syst Rev. 2007;(2):MR000016. DOI: https://doi.org/10.1002/14651858 PMid:38812899 PMCid:PMC7616025
Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, Schulz KF, Tibshirani R. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014 Jan 11;383(9912):166-175. DOI: https://doi.org/10.1016/S0140-6736(13)62227-8 PMid:24411645
Brainard J. Journals take up arms against AI-written text. Science. 2023;379(6634):740-741. DOI: https://doi.org/10.1126/science.adh2762 PMid:36821673
Beaudart C, Musuamba F, Locquet M, Dogné JM, Douxfils J. Hydroxychloroquine use during the first COVID-19 wave: a case study highlighting the urgent need to enhance research practices within the publication ecosystem. Arch Public Health. 2025 Apr 27;83(1):115. DOI: https://doi.org/10.1186/s13690-025-01596-2 PMID: 40289186 PMCID: PMC12034167
National Institutes of Health. Overview of Grant Application and Review Changes for Due Dates on or after January 25, 2025. Available from: https://grants.nih.gov/grants/guide/notice-files/NOT-OD-24-084.html [Accessed on August 30, 2025]
Kirkham J, Moher D. Who and why do researchers opt to publish in post-publication peer review platforms? - findings from a review and survey of F1000 Research. F1000Res. 2018 Jun 27;7:920. DOI: https://doi.org/10.12688/f1000research.15436.1 PMid:30079245 PMCid:PMC6053701
Dudda L, Kormann E, Kozula M, DeVito NJ, Klebel T, Dewi APM, Spijker R, Stegeman I, Van den Eynden V, Ross-Hellauer T, Leeflang MMG. Open science interventions to improve reproducibility and replicability of research: a scoping review. R Soc Open Sci. 2025 Apr 9;12(4):242057. DOI: https://doi.org/10.1098/rsos.242057 PMid:40206851 PMCid:PMC11979971
Vedham V, Parascandola M, Gravitt PE. Redefining expertise and evidence in global implementation research. Cancer Epidemiol Biomarkers Prev. 2023;32(6 Suppl):e1-e3. DOI: https://doi.org/10.1158/1055-9965.EPI-23-0320 PMid:37259552
Bavdekar SB, Tullu MS. Research publications for academic career advancement: an idea whose time has come. But is this the right way? J Postgrad Med. 2016;62(1):1-3. DOI: https://doi.org/10.4103/0022-3859.173184 PMid:26732190 PMCid:PMC4944322
Kumar P, Saxena D. Pandemic of publications and predatory journals: another nail in the coffin of academics. Indian J Community Med. 2016;41(3):169-171. DOI: https://doi.org/10.4103/0970-0218.183587 PMid:27385868 PMCid:PMC4919928
Beall J. Beall's list of potential predatory journals and publishers. [cited 2025 Aug 31]. Available from: https://beallslist.net/.
ICMJE. Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals. Available from: https://www.icmje.org/news-and-editorials/icmje-recommendations_annotated_jan24.pdf [Accessed on August 28, 2025]
National Library of Medicine. Research reporting guidelines and initiatives: by organization. [Internet]. Bethesda (MD): NLM; [updated 2023; cited 2025 Aug 21]. Available from: https://www.nlm.nih.gov/services/research_report_guide.html.
Cobo E, Cortés J, Ribera JM, et al. Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial. BMJ. 2011;343:d6783. DOI: https://doi.org/10.1136/bmj.d6783 PMid:22108262 PMCid:PMC3222149
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, Littlejohns P, Makarski J, Zitzelsberger L; AGREE Next Steps Consortium. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ. 2010 Dec 14;182(18):E839-42. DOI: https://doi.org/10.1503/cmaj.090449 PMID: 20603348 PMCID: PMC3001530
Wang B, Luo X, Zhang J, et al. Evaluating the Quality of Guidelines Using the AGREE II Tool by a Large Language Model vs Human Appraisers. JAMA Netw Open. 2025;8(5):e2512621. DOI: https://doi.org/10.1001/jamanetworkopen.2025.12621 PMid:40434777 PMCid:PMC12120650
EQUATOR Network. New partnership announced between the EQUATOR Network and the Center for Open Science (COS). Available from: https://www.equator-network.org/2024/05/02/new-partnership-announced-between-the-equator-network-and-the-center-for-open-science-cos/ [Accessed on August 25, 2025]
Harrington D, D'Agostino RB Sr, Gatsonis C, et al. New guidelines for statistical reporting in the journal. N Engl J Med. 2019;381(3):285-286. DOI: https://doi.org/10.1056/NEJMe1906559 PMid:31314974
Wasserstein RL, Schirm AL, Lazar NA. Moving to a world beyond "p < 0.05". Am Stat. 2019;73(Suppl 1):1-19. DOI: https://doi.org/10.1080/00031305.2019.1583913
Indrayan A. Statistical medicine: an emerging medical specialty. J Postgrad Med. 2017;63(4):252-256. DOI: https://doi.org/10.4103/jpgm.JPGM_189_17 PMid:29022563 PMCid:PMC5664870
Janczyk, Markus & Pfister, Roland. Bayesian Alternatives. Understanding Inferential Statistics 2023. DOI: https://doi.org/10.1007/978-3-662-66786-6_12
Ahmed, Ebadullah S. et al. The misunderstood P-value: why statistical significance is not enough in clinical practice British Journal of Anaesthesia, 2025;134 (4):909–913. DOI: https://doi.org/10.1016/j.bja.2025.01.008 PMid:39909800 PMCid:PMC11947593
Rosenthal JT, Beecy A, Sabuncu MR. Rethinking clinical trials for medical AI with dynamic deployments of adaptive systems. NPJ Digit Med. 2025 May 6;8(1):252. DOI: https://doi.org/10.1038/s41746-025-01674-3 PMid:40328886 PMCid:PMC12056174
Matarese V. Relationship between quality and editorial leadership of biomedical research journals: a comparative study of Italian and UK journals. PLoS One. 2008;3(7):e2512. DOI: https://doi.org/10.1371/journal.pone.0002512 PMid:18596938 PMCid:PMC2438474
Ioannidis JP, Khoury MJ. Assessing value in biomedical research: the PQRST of appraisal and reward. JAMA. 2014;312(5):483-484. DOI: https://doi.org/10.1001/jama.2014.6932 PMid:24911291 PMCid:PMC4687964
Kaur H. Ranking of top authors of medical research of India: quality vs quantity. J Med Res. 2018;4(4):179-181. DOI: https://doi.org/10.31254/jmr.2018.4404
Ioannidis JPA. How to make more published research true. PLoS Med. 2014;11(10):e1001747. DOI: https://doi.org/10.1371/journal.pmed.1001747 PMid:25334033 PMCid:PMC4204808
Hutchins BI, Yuan X, Anderson JM, Santangelo GM. Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level. PLoS Biol. 2016 Sep 6;14(9):e1002541. DOI: https://doi.org/10.1371/journal.pbio.1002541 PMid:27599104 PMCid:PMC5012559
Lv Y, Tang B, Liu X, et al. A comparative study of scientific publications in health care sciences and services from mainland China, Taiwan, Japan, and India (2007-2014). Int J Environ Res Public Health. 2016;13(1):79. DOI: https://doi.org/10.3390/ijerph13010079 PMid:26712774 PMCid:PMC4730470
Ueda R, Nishizaki Y, Homma Y, et al. Importance of quality assessment in clinical research in Japan. Front Pharmacol. 2019;10:1228. DOI: https://doi.org/10.3389/fphar.2019.01228 PMid:31680985 PMCid:PMC6814083
Hasbrouck LM, Taliano J, Hirshon JM, Dannenberg AL. Use of epidemiology in clinical medical publications, 1983-1999: a citation analysis. Am J Epidemiol. 2003;157(5):399-408. DOI: https://doi.org/10.1093/aje/kwf213 PMid:12578799
Garfield E. Journal impact factor: a brief review. CMAJ. 1999 Oct 19;161(8):979-980. PMID: 10551195; PMCID: PMC1230709.
A Kapil, Jain NC. Impact factor: Is it the ultimate parameter for the quality of publication? Indian Journal of Medical Microbiology.2016;34(1):1-2. DOI: https://doi.org/https://doi.org/10.4103/0255-0857.174127
Nagoba BS, Suryawanshi NM. Impact factor: an important parameter to decide the quality of publication. Indian J Med Microbiol. 2017;35(3):314. DOI: https://doi.org/10.4103/0255-0857.209587 PMid:28681831
Rasuli, B. and Nabavi, M. Altmetric.com or PlumX: Does it matter?. Learned Publishing.2024:37(4):e1631. DOI: https://doi.org/10.1002/leap.1631
Global trends in R&D 2025. Progress in recapturing momentum in Biopharma Innovation; March 2025. Available from: https://www.iqvia.com/insights/the-iqvia-institute/reports-and-publications/reports/global-trends-in-r-and-d-2025 [Accessed on August 25, 2025]
Rivera DR, Cutler TL, McShane L, et al. Modernizing Research and Evidence Consensus Definitions: A Food and Drug Administration-National Institutes of Health Collaboration. JAMA Netw Open. 2025;8(6):e2516674. DOI: https://doi.org/10.1001/jamanetworkopen.2025.16674 PMid:40526378
Akl EA, El-Hachem P, Abou-Haidar H, Neumann I, Schünemann HJ, Guyatt GH. Considering intellectual, in addition to financial, conflicts of interest proved important in a clinical practice guideline: a descriptive study. Journal of clinical epidemiology. 2014 Nov 1;67(11):1222-8. DOI: https://doi.org/10.1016/j.jclinepi.2014.05.006 PMid:24970099
Resnik DB. Institutional Conflicts of Interest in Academic Research. Sci Eng Ethics. 2019 Dec;25(6):1661-1669. DOI: https://doi.org/10.1007/s11948-015-9702-9 PMid:26446768 PMCid:PMC4824668
Ghooi RB. Conflict of interest in clinical research. Perspect Clin Res. 2015 Jan-Mar;6(1):10-14. DOI: https://doi.org/10.4103/2229-3485.148794 PMid:25657897 PMCid:PMC4314841
MA Ali. No room for ambiguity: The concepts of appropriate and inappropriate authorship in scientific publications. Indian Journal of Ophthalmology. 2021;69(1):36-41. DOI: https://doi.org/10.4103/ijo.IJO_2221_20 PMid:33323568 PMCid:PMC7926104
Dang A. Real-World Evidence: A Primer. Pharmaceut Med. 2023 Jan;37(1):25-36. DOI: https://doi.org/10.1007/s40290-022-00456-6 PMid:36604368 PMCid:PMC9815890
Murphy LA, Akehurst R, Cunningham D, de Pouvourville G, Solà-Morales O. Real-world evidence to support health technology assessment and payer decision making: is it now or never? Int J Technol Assess Health Care. 2025 Mar 31;41(1):e20. DOI: https://doi.org/10.1017/S0266462325000145 PMid:40162485 PMCid:PMC12018852
Abu-Odah H, Said NB, Nair SC, Allsop MJ, Currow DC, Salah MS, Hamad BA, Elessi K, Alkhatib A, ElMokhallalati Y, Bayuo J, AlKhaldi M. Identifying barriers and facilitators of translating research evidence into clinical practice: A systematic review of reviews. Health Soc Care Community. 2022 Nov;30(6):e3265-e3276. DOI: https://doi.org/10.1111/hsc.13898 PMid:35775332
Semahegn A, Manyazewal T, Hanlon C, Getachew E, et al. Challenges for research uptake for health policymaking and practice in low- and middle-income countries: a scoping review. Health Res Policy Syst. 2023 Dec 6;21(1):131. DOI: https://doi.org/10.1186/s12961-023-01084-5 PMid:38057873 PMCid:PMC10699029
Ball P. Is AI leading to a reproducibility crisis in science? Nature. 2023 Dec;624(7990):22-25. DOI: https://doi.org/10.1038/d41586-023-03817-6 PMid:38052897
Desai M. The integration of the data scientist into the team: Implications and challenges. Data Science. 2017;1(1-2):95-100. DOI: https://doi.org/10.3233/DS-170008
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Geetu Singh, Neelika Tripathi, Tanya Agarwal
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The authors retain the copyright of their article, with first publication rights granted to Medsci Publications.
