Large Language Models and Applied Surgical Anatomy: Evaluation of Anatomical Reasoning in Expert-Derived Plastic Surgery Scenarios
CLINICAL ANATOMY, cilt.0, sa.0, ss.1-10, 2026 (SCI-Expanded, Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 0 Sayı: 0
- Basım Tarihi: 2026
- Doi Numarası: 10.1002/ca.70243
- Dergi Adı: CLINICAL ANATOMY
- Derginin Tarandığı İndeksler: Natural Science Collection (ProQuest), Biological Science Database (ProQuest), Biomedical Reference Collection: Corporate Edition (EBSCO), Health Research Premium Collection (ProQuest), Scopus, Materials Science & Engineering Collection (ProQuest), Technology Collection (ProQuest), Aerospace Database, Science Citation Index Expanded (SCI-EXPANDED), EMBASE, MEDLINE
- Sayfa Sayıları: ss.1-10
- Açık Arşiv Koleksiyonu: AVESİS Açık Erişim Koleksiyonu
- Bursa Uludağ Üniversitesi Adresli: Evet
Özet
Large language models (LLMs) are increasingly being integrated into medical education, research, and clinical decision-support applications; however, their ability to apply anatomical knowledge in clinically relevant surgical scenarios remains insufficiently studied. This study evaluated and compared the performance of six contemporary LLMs (ChatGPT, Gemini, Claude, DeepSeek, Copilot, and Manus) using 25 expert-derived applied surgical anatomy scenarios relevant to plastic surgery. Scenarios were developed by an expert panel consisting of one associate professor of anatomy and two plastic surgeons. Responses were generated using a standardized prompt and assessed with a structured scoring rubric evaluating anatomical accuracy, clinical reasoning, completeness, and safety, with a maximum score of 10 points per question. Critical errors were additionally assessed. Significant differences in overall performance were observed among models (Friedman χ2 = 43.51, p < 0.001). ChatGPT achieved the maximum aggregate score (250/250), followed by Gemini (248/250), DeepSeek (241/250), Copilot (240/250), Claude (235/250), and Manus (219/250). Critical errors were infrequent and were confined to a reconstructive vascular physiology scenario: DeepSeek, Claude, and Manus each demonstrated one observed critical error, whereas ChatGPT, Gemini, and Copilot demonstrated none. Although all evaluated models demonstrated excellent performance, clinically significant anatomical misconceptions persisted despite high aggregate scores. These findings demonstrate strong performance by the tested LLMs on this specific scenario-based benchmark, while also identifying clinically meaningful anatomical errors in a subset of responses. Future evaluations should focus not only on overall accuracy but also on clinically meaningful error patterns that may influence surgical decision-making. Importantly, substantial ceiling effects limited discrimination among high-performing models, and the findings should therefore be interpreted as performance on this specific benchmark rather than as evidence of a general hierarchy of anatomical reasoning capability.