Evaluation of ChatGPT’s Performance in the Turkish Board of Orthopaedic Surgery Examination
PDF
Cite
Share
Request
Letter to the Editor
VOLUME: 62 ISSUE: 5
P: 319 - 319
November 2024

Evaluation of ChatGPT’s Performance in the Turkish Board of Orthopaedic Surgery Examination

Med Bull Haseki 2024;62(5):319-319
1. University of Health Sciences Turkey Taksim Training and Research Hospital, Clinic of Internal Medicine, Istanbul, Turkey
No information available.
No information available
Received Date: 18.11.2024
Accepted Date: 16.12.2024
Online Date: 27.01.2025
Publish Date: 27.01.2025
PDF
Cite
Share
Request

Dear Editor,

I read Ahmet Yigitbay intriguing work on the artificial intelligence tool ChatGPT. The widespread use and accessibility of artificial intelligence tools will certainly affect medical education. Currently, many medical students use artificial intelligence tools that convert voice recordings into text and pictures instead of taking notes in lectures (1). I believe that in the near future, artificial intelligence will have a place in all areas of the education process, such as learning, teaching, and evaluation. The fact that ChatGPT was not as successful as humans in answering the questions in this study conducted by Yigitbay suggests that these tools have not yet matured for widespread use.

In the method section of the study, the author stated that the TOTEK exam questions between 2019 and 2023 were asked to be answered via ChatGPT. It is understood that questions were asked of ChatGPT in 2024, the year this study was conducted. However, when analyzing by years in the results section, it is understood as if these questions were asked to ChatGPT every year between 2019 and 2023. This is particularly evident in the third paragraph of the Results. In the last sentence of this paragraph, it is stated that this variability may stem from changes in the datasets used to train the model, updates to the model itself, or differences in the complexity of exam questions across the years (2). Since all questions were asked of ChatGPT at the same time (2024), it cannot be considered that the artificial intelligence training data has changed.

Financial Disclosure: This study received no financial support.

Financial Disclosure: This study received no financial support.

References

1
Yadlapally DK, Vasireddy B, Marimganti M, Chowdary T, Karthikeyan C, Vignesh T, “A review on the potential of ai voice assistants for personalized and adaptive learning in education” 2023 7th International Conference on Computing Methodologies and Communication (ICCMC). IEEE, 2023.
2
Yigitbay A. Evaluation of ChatGPT’s Performance in the Turkish Board of Orthopedic Surgery Examination. Med Bull Haseki. 2024;62:243-49.