MONDAY, May 22, 2023 (HealthDay News) — The natural language processing model Chat Generative Pretrained Transformer (ChatGPT) does not pass the American College of Gastroenterology (ACG) Self-Assessment Tests, according to a study published online May 22 in the American Journal of Gastroenterology.
Kelly Suchman, M.D., from the Zucker School of Medicine at Hofstra/Northwell and the Long Island Jewish Medical Center in New Hyde Park, New York, and colleagues assessed ChatGPT-3 and ChatGPT-4 performance on the 2022 and 2021 ACG Self-Assessment Tests. A 70 percent score or higher was required to pass the assessment.
The researchers found that ChatGPT-3 and ChatGPT-4 scored 65.1 and 62.4 percent, respectively, on 455 included questions across the two exams.
“Recently, there has been a lot of attention on ChatGPT and the use of artificial intelligence across various industries. When it comes to medical education, there is a lack of research around this potential ground-breaking tool,” a coauthor said in a statement. “Based on our research, ChatGPT should not be used for medical education in gastroenterology at this time and has a ways to go before it should be implemented into the health care field.”
People are also reading…
Two authors disclosed ties to the medical device and biotechnology industries.
For all the latest Health News Click Here
For the latest news and updates, follow us on Google News.
Denial of responsibility! NewsBit.us is an automatic aggregator around the global media. All the content are available free on Internet. We have just arranged it in one platform for educational purpose only. In each content, the hyperlink to the primary source is specified. All trademarks belong to their rightful owners, all materials to their authors. If you are the owner of the content and do not want us to publish your materials on our website, please contact us by email – [email protected]. The content will be deleted within 24 hours.
