2022-12-20 DEC

News from NeurIPS 2023; breaking the rules with electron Apps

Journal Club

NeurIPS | 2023 [Jeya] 

Thirty-seventh Conference on Neural Information Processing Systems

News / Highlights / paper awards



Use of GPT-4 to Diagnose Complex Clinical Cases [Adalberto]

https://ai.nejm.org/doi/10.1056/AIp2300031 [pdf]

Abstract
We assessed the performance of the newly released AI GPT-4 in diagnosing complex medical case challenges and compared the success rate to that of medical-journal readers. GPT-4 correctly diagnosed 57% of cases, outperforming 99.98% of simulated human readers generated from online answers. We highlight the potential for AI to be a powerful supportive tool for diagnosis; however, further improvements, validation, and addressing of ethical considerations are needed before clinical implementation.

Data
We identified 38 clinical case challenges and a total of248,614 answers from online medical-journal readers. Reference diagnostic dataset: The New England Journal of Medicine Case challenges: https://www.nejm.org/case-challenges.

Results
Figure1 - https://ai.nejm.org/doi/10.1056/AIp2300031 

Conclusions
Society is expected to increasingly rely on AI as a tool to support the decision-making process with human oversight, rather than as a replacement for physicians.

Hackathon