This paper presents the development and evaluation of an interactive AI agent, Ernie-fdear, that leverages large language models and computer vision techniques to address the prevalent issue of newborn auricular deformities.
The key components of the agent are:
Expert Diagnosis Module: This module utilizes PaddleDetection, a deep learning-based object detection framework, to accurately classify different types of auricular deformities from uploaded images with a precision rate of 75%.
Expert Knowledge Module: This module employs Retrieval-Augmented Generation (RAG), a technique that combines pre-trained language models with non-parametric memory, to provide professional and informative responses to user queries about auricular deformities and their treatment.
The agent's effectiveness was evaluated through two main experiments:
The expert diagnosis module was tested on a dataset of 3,852 newborn ear images, achieving a 90% accuracy in distinguishing normal and abnormal ears.
The expert knowledge module was assessed through a questionnaire administered to three groups: medical professionals, users of the general Ernie language model, and users of the Ernie-fdear agent. The Ernie-fdear user group performed similarly to the medical professionals, demonstrating the agent's ability to effectively educate the public on auricular deformities.
The paper highlights the potential of this AI-powered interactive agent to enhance the treatment of auricular deformities by enabling early detection and improving public awareness, especially in remote and underserved areas. The authors suggest that this approach can be extended to address other newborn health issues that require timely intervention.
다른 언어로
소스 콘텐츠 기반
arxiv.org
더 깊은 질문