Page 59 - Read Online

Boyd et al. Art Int Surg 2024;4:316-23 https://dx.doi.org/10.20517/ais.2024.53 Page 322

more LLM outputs spanning more plastic surgery procedures. This focus on a singular topic within plastic
surgery may not be representative of either LLM’s overall working knowledge or capabilities in other topic
areas within plastic surgery. Future work will aim to develop an efficient methodology for analyzing a
higher volume of LLM outputs so that more individual queries can be readily analyzed and subsequent
studies can include a wider range of procedures and topics within plastic surgery. While a distinct session
was created to limit the effect of learning from the NLPs, it would be interesting to assess what impact
repeated use of the same NLP may have on the fidelity of AI-generated outputs used in a clinical scenario.

In summary, this study represents the first attempt to classify the effectiveness of Doximity GPT at
producing medically sound, readable responses for a commonly performed plastic surgery procedure. This
initial work highlights the promise of RLHF as a mechanism to establish a plastic surgery-focused AI
platform that can help augment the patient experience and assist surgical practices with their clinical
workflow .
[6]

An initial assessment of the medical accuracy and linguistic readability of healthcare-specific AI-generated
outputs demonstrated reasonable responses to common patient questions following breast augmentation.
Future studies can aim to develop quantifiable methodologies for evaluating the clinical accuracy of AI-
generated information for a broader range of surgical procedures. This could inform surgeons across
different subspecialties within plastic surgery seeking to incorporate LLMs into their clinical practice and
may serve as a useful tool for plastic surgery patients in the 21st century.

DECLARATIONS
Authors’ contributions
Made substantial contributions to the conception and design of the study, performed data collection,
performed data analysis and interpretation, and participated in manuscript writing and editing: Boyd CJ,
Perez Rivera LR, Hemal K, Sorenson TJ, Amro C
Made substantial contributions to the conception and design of the study, assisted in data interpretation,
and participated in manuscript writing and editing: Karp NS, Choi M

Availability of data and materials
Data supporting the findings of this study are available in Supplementary Table 1.

Financial support and sponsorship
None.

Conflicts of interest
All authors declared that there are no conflicts of interest.

Ethical approval and consent to participate
Not applicable.

Consent for publication
Not applicable.

Copyright
© The Author(s) 2024.