Skip to content
Home▶Archive▶Vol. 9 No. 1 (2026)▶Assessment of ChatGPT-Generated Endodontic Patient…
Academia Journal of Medicine
Print ISSN 2663-8282 · Online ISSN 2663-8290
Research Article

Assessment of ChatGPT-Generated Endodontic Patient Education Materi als: A Readability and Accuracy Analysis

, , , ,
Perisetty Dinesh Kumar — Reader, Department of Conservative Dentistry & Endodontics, Narayana Dental college & Hospital, Chintha Reddy Palem, Nellore, Andhra Pradesh 524002.
Shrenik Nahata — Senior Lecturer, Department of Oral Pathology and Microbiology, Rungta College of Dental Sciences and Research, Bhilai, Chhattisgarh
Sumit Bhatt — PhD Scholar, Assistant Professor, Department of Oral and Maxillofacial Surgery, Rajasthan Dental College & Hospital, Nirwan University, Jaipur, Rajasthan
Sai Sagar — Senior House Surgeon, Govt Hospital Neyattinkara, Trivandrum, Kerala.
Milind Rajan — PhD Scholar, Department of Pediatric Dentistry, Sharad Pawar Dental College and Hospital, Datta Meghe Institute of Higher Education and Research, Wardha-442107.
Published 12 Jun 2026 Vol. 9 No. 1 (2026), pp. 210-214 ● Open access
Formats:PDF ● Open access
Download PDF

Abstract

Background: The increasing use of artificial intelligence–based conversational models  such as ChatGPT has transformed the way patients access healthcare-related information.  In endodontics, patients frequently seek online educational material regarding root canal  treatment and related conditions. However, the readability and scientific accuracy of AI generated dental information remain uncertain. Aim: To evaluate the readability and scientific accuracy of ChatGPT-generated patient  education materials related to common endodontic conditions and procedures. Materials and Methods: A cross-sectional analytical study was conducted using 100 patient oriented responses generated by ChatGPT. Ten standardized endodontic prompts related  to root canal treatment, dental abscess, infected teeth, post-treatment care, and treatment  complications were entered ten separate times under identical settings. The generated  responses were collected without modification. Readability assessment was performed using  the Flesch Reading Ease Score, Flesch–Kincaid Grade Level, SMOG Index, and Gunning  Fog Index. Scientific accuracy and quality of information were independently evaluated by  three experienced endodontists using a structured 5-point Likert scale assessing accuracy,  completeness, clarity, misleading information, and clinical usefulness. Statistical analysis was  performed using descriptive statistics and Cohen’s kappa test for inter-examiner reliability. Results: ChatGPT-generated educational materials demonstrated moderate to high  readability, with most responses corresponding to a secondary school reading level. The  majority of responses showed good scientific accuracy, clarity, and clinical usefulness.  However, certain responses lacked comprehensive explanations regarding procedural  complications and emergency management. Minor inconsistencies and oversimplified  information were observed in selected outputs. Inter-examiner agreement among evaluators  was high. Conclusion: ChatGPT demonstrated promising potential in generating readable and  reasonably accurate endodontic patient education materials. Nevertheless, professional  verification by dental experts remains necessary before clinical use to ensure reliability and  prevent dissemination of incomplete or misleading information. 

 

KeywordsChatGPTArtificial IntelligenceEndodonticsPatient EducationReadability

The full text of this article is available as a PDF.

Download PDF
  1. Alhussain G, Kelly A, O’Flaherty EI, Quinn DP, Flaherty GT. Emerging role of artificial intelligence in global health care. Health Policy Technol. 2022 Sep;11(3):100661.
  2. Jha Kukreja B, Kukreja P. Integration of Artificial Intelligence in Dentistry: A Systematic Review of Educational and Clinical Implications. Cureus. 2025 Feb 20;17(2):e79350.
  3. Casheekar A, Lahiri A, Rath K, Prabhakar KS, Srinivasan K. A contemporary review on chatbots, AI-powered virtual conversational agents, ChatGPT: Applications, open challenges and future research directions. Comput Sci Rev. 2024;52:100632.
  4. Wang L, Wan Z, Ni C, Song Q, Li Y, Clayton E, Malin B, Yin Z. Applications and Concerns of ChatGPT and Other Conversational Large Language Models in Health Care: Systematic Review. J Med Internet Res. 2024 Nov 7;26:e22769.
  5. Funkhouser E, Agee BS, Gordan VV, Rindal DB, Fellows JL, Qvist V, et al. Use of online sources of information by dental practitioners: Findings from The Dental Practice-Based Research Network. J Public Health Dent. 2014;74(1):71-79.
  6. Schierz O, Hirsch C, Krey KF, Ganss C, Kämmerer PW, Schlenz MA. Digital dentistry and its impact on oral health-related quality of life. J Evid Based Dent Pract. 2024;24(1 Suppl):101946.
  7. Miller T, Reihlen M. Assessing the impact of patient-involvement healthcare strategies on patients, providers, and the healthcare system: A systematic review. Patient Educ Couns. 2023;110:107652.
  8. Feng S, Li X, Wake AN. Engaging artificial intelligence (AI)-based chatbots in digital health: A systematic review. PLOS Digit Health. 2026;5(2):e0001201.
  9. Singh S, Jamal A, Qureshi F. Readability Metrics in Patient Education: Where Do We Innovate? Clin Pract. 2024 Nov 4;14(6):2341-2349.
  10. Bekbolatova M, Mayer J, Ong CW, Toma M. Transformative Potential of AI in Healthcare: Definitions, Applications, and Navigating the Ethical Landscape and Public Perspectives. Healthcare (Basel). 2024 Jan 5;12(2):125.
  11. Samaranayake L, Tuygunov N, Schwendicke F, Osathanon T, Khurshid Z, Boymuradov SA, Cahyanto A. The Transformative Role of Artificial Intelligence in Dentistry: A Comprehensive Overview. Part 1: Fundamentals of AI, and its Contemporary Applications in Dentistry. Int Dent J. 2025 Apr;75(2):383-396.
  12. Gupta E, Maysan S, Murella S, Saju AR, Grover S, Vasudeva A. Recent dental practices using Artificial Intelligence (AI): A survey. Bioinformation. 2025 Mar 31;21(3):514-521.
  13. Wu X, Zhang B. ChatGPT promotes healthcare: Current applications and potential challenges. Int J Surg. 2024 Jan 1;110(1):606-608.
  14. Llorente de Pedro M, Suárez A, Algar J, Díaz-Flores García V, Andreu-Vázquez C, Freire Y. Assessing ChatGPT’s reliability in endodontics: Implications for AI-enhanced clinical learning. Appl Sci. 2025;15(10):5231.
  15. Hamada M, Kikuchi S, Akitomo T, Kusaka S, Iwamoto Y, Nomura R. Applications and potential of ChatGPT in dentistry: Scoping review of research perspectives. J Dent Sci. 2026;21(1):1-8.
  16. Achanur M, Bhatt S, Maniyar RN, Sajjanar AK, Roy A, Rao V, et al. ChatGPT’s emerging role in dentistry: A review. J Pharm Bioallied Sci. 2025;17(Suppl 1):S99-S101.

Looking up citing articles…