Journals / Journal of Health Sciences and Medicine / 2026 / Volume: 9 Issue: 5

Evaluation of large language model responses to expert questions in anterior implant dentistry: quality, accuracy, and readability

Dalndushe Abdulai(BIRUNI UNIVERSITY, FACULTY OF DENTISTRY)0000-0002-8994-7262
Raghib Suradi(BIRUNI UNIVERSITY, FACULTY OF DENTISTRY)0000-0001-9302-2185
Mehran Moghbel(BIRUNI UNIVERSITY, FACULTY OF DENTISTRY)0000-0002-4502-8950
Pages
—
Publication Date
2026-09-19
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

Gemini showed the highest numerical GQS value (GQS: 3.75±0.77); however, the overall effect size was small, and no GQS pairwise comparison remained statistically significant after adjustment.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:Aims: This study evaluated the quality, accuracy, and readability of responses generated by four Artificial Intelligence (AI) chatbots based on large language models (LLMs): ChatGPT-5.2, Gemini 3, DeepSeek-V3.2, and Grok-4.1, when responding to expert-generated questions in anterior implant dentistry.
📊
Key Findings & Data:The aim was to evaluate their potential role as educational and adjunct informational tools in treatment planning and esthetic zone management, while also examining the readability of the generated responses.
💡
Conclusion & Impact:Gemini showed the highest numerical GQS value (GQS: 3.75±0.77); however, the overall effect size was small, and no GQS pairwise comparison remained statistically significant after adjustment.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Artificial Intelligence · dental implants · esthetics

Abstract

Aims: This study evaluated the quality, accuracy, and readability of responses generated by four Artificial Intelligence (AI) chatbots based on large language models (LLMs): ChatGPT-5.2, Gemini 3, DeepSeek-V3.2, and Grok-4.1, when responding to expert-generated questions in anterior implant dentistry. The aim was to evaluate their potential role as educational and adjunct informational tools in treatment planning and esthetic zone management, while also examining the readability of the generated responses. Methods: Thirty-six standardized questions covering diagnosis, esthetic risk assessment, implant positioning, surgical planning, peri-implant soft tissue management, esthetic complications, and preventive strategies were developed by three prosthodontists experienced in implant dentistry. Responses from ChatGPT, Gemini, DeepSeek, and Grok were independently evaluated by three experts using the modified DISCERN (mDISCERN) score, Global Quality Score (GQS), and a five-point Accuracy Score. Misinformation and Harm scores were also recorded. Repeated-measures comparisons were performed using the Friedman test with Wilcoxon signed-rank post hoc analysis and Bonferroni correction. Results: ChatGPT demonstrated the highest mean scores for informational reliability (mDISCERN: 3.33±0.72) and accuracy (3.56±0.84); however, differences in accuracy were not statistically significant. Gemini showed the highest numerical GQS value (GQS: 3.75±0.77); however, the overall effect size was small, and no GQS pairwise comparison remained statistically significant after adjustment. Grok showed intermediate performance, whereas DeepSeek showed lower numerical reliability scores, with significant pairwise differences identified only in comparison with ChatGPT and Gemini. Significant differences were observed for mDISCERN [χ² (3)=17.52, p 0.05). Readability analysis showed a small but statistically significant difference in FRES among the chatbots, with Gemini demonstrating easier readability than Grok after Bonferroni adjustment, whereas FKGL did not differ significantly among the models; overall, the responses required a high-school to early undergraduate reading level. Conclusion: AI chatbots can generate information with potential clinical relevance in anterior implant dentistry; however, variability in informational reliability persists. Although ChatGPT showed slightly higher numerical scores for some outcomes, the observed differences were generally small, and no chatbot demonstrated clear superiority across all evaluated measures. Expert supervision therefore remains essential before integrating such tools into clinical education.

🔖

Cite This Article

Abdulai, D., Suradi, R., Moghbel, M. (2026). Evaluation of large language model responses to expert questions in anterior implant dentistry: quality, accuracy, and readability. Journal of Health Sciences and Medicine, Volume: 9 Issue: 5. https://doi.org/10.32322/jhsm.1923211

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (31)

  1. Alzahrani M, Bakhreibah S, Alharbi N, et al. Failure rate of dental implants in the esthetic zone: a systematic review and meta-analysis. Cureus. 2024;16(7):e65506. doi:10.7759/cureus.65506
  2. Buser D, Martin W, Belser UC. Optimizing esthetics for implant restorations in the anterior maxilla: anatomic and surgical considerations. Int J Oral Maxillofac Implants. 2004;19(Suppl):43-61.
  3. Belser UC, Schmid B, Higginbottom F, Buser D. Outcome analysis of implant restorations located in the anterior maxilla: a review of the recent literature. Int J Oral Maxillofac Implants. 2004;19(Suppl):30-42.
  4. Cosyn J, Eghbali A, De Bruyn H, Collys K, Cleymaet R, De Rouck T. Immediate single-tooth implants in the anterior maxilla: 3-year results of a case series on hard and soft tissue response and aesthetics. J Clin Periodontol. 2011;38(8):746-753. doi:10.1111/j.1600-051X.2011.01748.x
  5. Chen ST, Buser D. Esthetic outcomes following immediate and early implant placement in the anterior maxilla: a systematic review. Int J Oral Maxillofac Implants. 2014;29(Suppl):186-215. doi:10.11607/jomi.2014suppl.g3.3
  6. Ickroth A, Christiaens V, Pitman J, Cosyn J. A systematic review on immediate implant placement in intact versus non-intact alveolar sockets. J Clin Med. 2025;14(7):2462. doi:10.3390/jcm14072462
  7. Wu XY, Shi JY, Buti J, Lai HC, Tonetti MS. Buccal bone thickness and mid-facial soft tissue recession after various surgical approaches for immediate implant placement: a systematic review and network meta-analysis of controlled trials. J Clin Periodontol. 2023;50(4):533-546. doi:10.1111/jcpe.13771
  8. Gehrke P, Lobert M, Dhom G. Reproducibility of the pink esthetic score: rating soft tissue esthetics around single-implant restorations with regard to dental observer specialization. J Esthet Restor Dent. 2008;20(6):375-385. doi:10.1111/j.1708-8240.2008.00212.x
  9. Tettamanti S, Millen C, Gavric J, et al. Esthetic evaluation of implant crowns and peri-implant soft tissue in the anterior maxilla: comparison and reproducibility of three different indices. Clin Implant Dent Relat Res. 2016;18(3):517-526. doi:10.1111/cid.12306
  10. Hof M, Pommer B, Strbac GD, Sütö D, Watzek G, Zechner W. Esthetic evaluation of single-tooth implants in the anterior maxilla following autologous bone augmentation. Clin Oral Implants Res. 2013;24(Suppl A100):88-93. doi:10.1111/j.1600-0501.2011.02381.x
  11. Stefanini M, Pispero A, Del Fabbro M, et al. The effect of keratinized mucosa on peri-implant health and patient-reported outcome measures: a systematic review and meta-analysis. Appl Sci. 2023;13:8631. doi:10.3390/app13158631
  12. Atieh MA, Alsabeeha NHM. Soft tissue changes after connective tissue grafts around immediately placed and restored dental implants in the esthetic zone: a systematic review and meta-analysis. J Esthet Restor Dent. 2020;32(3):280-290. doi:10.1111/jerd.12538
  13. Durante-Lacambra R, Taheri RB, Leco-Berrocal MI, López-Carriches C. Influence of connective tissue grafts on implants in the aesthetic area: a systematic review. Are connective grafts essential? J Clin Exp Dent. 2024;16(6):e772-e777. doi:10.4317/jced.61668
  14. Ioannou AL, Kotsakis GA, McHale MG, Lareau DE, Hinrichs JE, Romanos GE. Soft tissue surgical procedures for optimizing anterior implant esthetics. Int J Dent. 2015;2015:740764. doi:10.1155/2015/740764
  15. Thirunavukarasu AJ, Ting DSJ, Elangovan K, Gutierrez L, Tan TF, Ting DSW. Large language models in medicine. Nat Med. 2023;29(8):1930-1940. doi:10.1038/s41591-023-02448-8
  16. Bommasani R, Hudson DA, Adeli E, et al. On the opportunities and risks of foundation models. arXiv. 2021. doi:10.48550/arXiv.2108.07258
  17. Brown TB, Mann B, Ryder N, et al. Language models are few-shot learners. Adv Neural Inf Process Syst. 2020;33:1877-1901.
  18. Sallam M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare (Basel). 2023;11(6):887. doi:10.3390/healthcare11060887
  19. Gilson A, Safranek CW, Huang T, et al. How does ChatGPT perform on the United States Medical Licensing Examination (USMLE)? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ. 2023;9:e45312. doi:10.2196/45312
  20. Claman D, Sezgin E. Artificial Intelligence in dental education: opportunities and challenges of large language models and multimodal foundation models. JMIR Med Educ. 2024;10:e52346. doi:10.2196/52346
  21. Kaplan TT, Akyol GE. The role of large language models in dental diagnosis, decision-making, and communication: a systematic review. Jpn Dent Sci Rev. 2026;62:57-67. doi:10.1016/j.jdsr.2026.01.002
  22. OpenAI. GPT-4 technical report. arXiv. 2023:8774. doi:10.48550/arXiv.2303.08774
  23. Kung TH, Cheatham M, Medenilla A, et al. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLoS Digit Health. 2023;2(2):e0000198. doi:10.1371/journal.pdig.0000198
  24. Team Gemini, Google DeepMind. Gemini: a family of highly capable multimodal models. arXiv. 2023. arXiv:2312.11805. doi:10.48550/arXiv.2312.11805
  25. DeepSeek-AI. DeepSeek LLM: scaling open-source language models with long-context reasoning. arXiv. 2024. arXiv:2401.02954. doi:10.48550/arXiv.2401.02954
  26. xAI. Introducing Grok: a conversational AI model integrated with real-time information [Internet]. xAI; 2023. Available from: https://x.ai/blog/grok
  27. Bulut AC, Bahadır HS, Ateş G. Artificial Intelligence in dental education: can AI-based chatbots compete with general practitioners? BMC Med Educ. 2025;25(1):1319. doi:10.1186/s12909-025-07880-7
  28. Suri RA, Gohel C, Alghamdi W, Crowther B, Garcia AI, Gohel A. Perceptions of dental students on the integration of Artificial Intelligence in radiology clinical education. Front Dent Med. 2026;6:1735299. doi:10.3389/fdmed.2025.1735299
  29. Dave M, Tattar R, Alafaleg R, et al. Performance of large language models (ChatGPT-4.0, Grok2 and Gemini) in UK dentistry and dental hygiene and therapy assessments. Br Dent J. 2025. doi:10.1038/s41415-025-8383-2
  30. Özbay Y, Erdoğan D, Dinçer GA. Evaluation of the performance of large language models in clinical decision-making in endodontics. BMC Oral Health. 2025;25(1):648. doi:10.1186/s12903-025-06050-x
  31. Morton D, Wismeijer D, Chen S, et al. Group 5 ITI consensus report: implant placement and loading protocols. Clin Oral Implants Res. 2023;34(Suppl 26):349-356. doi:10.1111/clr.14137