-
Mashup Score: 0Colorectal Cancer Prevention: Is Chat Generative Pretrained ... : Journal of Clinical Gastroenterology - 7 hour(s) ago
o CRC screening guidelines. Adoption of newer technologies can help improve the delivery of such preventive care services. Methods: An assessment with 10 multiple choice questions, including 5 CRC screening and 5 CRC surveillance clinical vignettes, was inputted into chat generative pretrained transformer (ChatGPT) 3.5 in 4 separate sessions. Responses were recorded and screened for accuracy to determine the reliability of this tool. The mean number of correct answers was then compared against a control group of gastroenterologists and colorectal surgeons answering the same questions with and without the help of a previously validated CRC screening mobile app. Results: The average overall performance of ChatGPT was 45%. The mean number of correct answers was 2.75 (95% CI: 2.26-3.24), 1.75 (95% CI: 1.26-2.24), and 4.5 (95% CI: 3.93-5.07) for screening, surveillance, and total questions, respectively. ChatGPT showed inconsistency and gave a different answer in 4 questions among the diffe
Source: journals.lww.comCategories: General Medicine News, GastroenterologyTweet
ChatGPT scored 45% on CRC screening vignettes, far below physicians' 77% (with app) and 56% (without). AI needs refinement for clinical use. Read more below. #AIinMedicine #ColorectalCancer https://t.co/GneV0i3hfs