Enhancing AI Chatbot Responses in Healthcare: The SMART Prompt Structure in Head and Neck Surgery DOI Creative Commons
Luigi Angelo Vaira, Jérôme R. Lechien, Vincenzo Abbate

и другие.

Research Square (Research Square), Год журнала: 2024, Номер unknown

Опубликована: Авг. 23, 2024

Abstract Objective. To evaluate the impact of prompt construction on quality AI chatbot responses in context head and neck surgery. Study design. Observational evaluative study. Setting. International collaboration involving 16 researchers from 11 European centers specializing Methods. A total 24 questions, divided into clinical scenarios, theoretical patient inquiries, were developed. These questions inputted ChatGPT-4o both with without use a structured format, known as SMART (Seeker, Mission, Role, Register, Targeted Question). The AI-generated evaluated by experienced surgeons using QAMAI instrument, which assesses accuracy, clarity, relevance, completeness, source quality, usefulness. Results. generated scored significantly higher across all dimensions compared to those contextualized prompts. Median scores for prompts 27.5 (IQR 25–29) versus 21.8–25) unstructured (p < 0.001). Clinical scenarios inquiries showed most significant improvements, while also benefited but lesser extent. AI's improved notably prompt, particularly questions. Conclusions. study suggests that format enhances This approach improves completeness information, underscoring importance well-constructed applications. Further research is warranted explore applicability different medical specialties platforms.

Язык: Английский

Artificial Intelligence Meets Antibiotics: Is this a Match Made in Heaven for Antimicrobial Stewardship? DOI
Nicole Bradley, Yuman Lee

Current Infectious Disease Reports, Год журнала: 2025, Номер 27(1)

Опубликована: Апрель 2, 2025

Язык: Английский

Процитировано

0
Assessing the accuracy and clinical utility of GPT-4O in abnormal blood cell morphology recognition DOI Creative Commons
Xinjian Cai, Lili Zhan, Lin Yang

и другие.

Digital Health, Год журнала: 2024, Номер 10

Опубликована: Янв. 1, 2024

Objectives To evaluate the accuracy and clinical utility of GPT-4O in recognizing abnormal blood cell morphology, a critical component hematologic diagnostics. Methods GPT-4O's morphology recognition capabilities were assessed by comparing its performance with hematologists. A total 70 images from Chinese National Center for Clinical Laboratories, External Quality Assessment (EQA) 2022 to 2024 analyzed. Two experienced hematology experts evaluated using Likert scale. Results achieved an overall 70% recognition, significantly lower than 95.42% hematologists (p < 0.05). For peripheral smears bone marrow smears, was 77.14% 62.86% respectively. scale evaluations revealed further discrepancies, scoring 288.50 out 350, compared higher manual scores. accurately recognized certain intracellular inclusions such as Howell-Jolly bodies Auer rods, while it misidentified fragmented red cells neutrophilic metamyelocytes oval-shaped sickle cells. Additionally, had difficulty identifying granules distinguishing nuclei cytoplasm. Conclusion is currently inadequate Despite potential supplementary tool, significant improvements algorithms expanded dataset are necessary be reliable use. Future research should focus on enhancing diagnostic addressing current limitations.

Язык: Английский

Процитировано

2
Enhancing AI Chatbot Responses in Healthcare: The SMART Prompt Structure in Head and Neck Surgery DOI Creative Commons
Luigi Angelo Vaira, Jérôme R. Lechien, Vincenzo Abbate

и другие.

Research Square (Research Square), Год журнала: 2024, Номер unknown

Опубликована: Авг. 23, 2024

Abstract Objective. To evaluate the impact of prompt construction on quality AI chatbot responses in context head and neck surgery. Study design. Observational evaluative study. Setting. International collaboration involving 16 researchers from 11 European centers specializing Methods. A total 24 questions, divided into clinical scenarios, theoretical patient inquiries, were developed. These questions inputted ChatGPT-4o both with without use a structured format, known as SMART (Seeker, Mission, Role, Register, Targeted Question). The AI-generated evaluated by experienced surgeons using QAMAI instrument, which assesses accuracy, clarity, relevance, completeness, source quality, usefulness. Results. generated scored significantly higher across all dimensions compared to those contextualized prompts. Median scores for prompts 27.5 (IQR 25–29) versus 21.8–25) unstructured (p < 0.001). Clinical scenarios inquiries showed most significant improvements, while also benefited but lesser extent. AI's improved notably prompt, particularly questions. Conclusions. study suggests that format enhances This approach improves completeness information, underscoring importance well-constructed applications. Further research is warranted explore applicability different medical specialties platforms.

Язык: Английский

Процитировано

1