MED-Prompt: A novel prompt engineering framework for medicine prediction on free-text clinical notes
Ahmed, Awais and Zeng, Xiaoyang and Xi, Rui and Hou, Mengshu and Shah, Syed Attique (2024) MED-Prompt: A novel prompt engineering framework for medicine prediction on free-text clinical notes. Journal of King Saud University - Computer and Information Sciences, 36 (2). p. 101933. ISSN 1319-1578
|
Text
1-s2.0-S1319157824000223-main.pdf - Published Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (1MB) |
Abstract
Existing AI-based medicine prediction systems require substantial training time, computing resources, and extensive labeled data, yet they often lack scalability. To bridge these gaps, this study introduces a novel MED-Prompt framework that employs pretrained models such as BERT, BioBERT, and ClinicalBERT. The core of our framework lies in developing specialized prompts, which act as guiding instructions for the models during the prediction process. MED-Prompt develops prompts that help models interpret and extract medical information from clinical corpus. The clinical text was derived from the widely known MIMIC-III 1 dataset. The study performs a comparative analysis and evaluates the performance of Manual-Prompt and GPT-Prompts. Further, a fine-tuned approach is developed within MED-Prompt, leveraging transfer learning to achieve prompt-guided medicine predictions. The proposed method achieved a maximum F1-score of 96.8%, which is more than 40% F1-score higher than the pretrained model. In addition, the fine-tuned also showed an average of 2.38 times better processing performance. These results revealed that MED-Prompt is scalable regarding the number of training records and input prompts. These results not only demonstrate the proficiency and effectiveness of the framework but also significantly reduce computational requirements. This also indicates that the proposed approach has the potential to significantly improve patient care, reduce resource requirements, and increase the overall effectiveness of AI-driven medical prediction systems.
| Item Type: | Article | ||||||
|---|---|---|---|---|---|---|---|
| Identification Number: | https://doi.org/10.1016/j.jksuci.2024.101933 | ||||||
| Dates: |
|
||||||
| Uncontrolled Keywords: | AI-enabled healthcare decisions, Medical prompts, Pretrained models, Free-text clinical notes, natural language processing | ||||||
| Subjects: | CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science | ||||||
| Divisions: | Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology | ||||||
| Depositing User: | Gemma Tonks | ||||||
| Date Deposited: | 27 Feb 2024 11:39 | ||||||
| Last Modified: | 27 Feb 2024 11:39 | ||||||
| URI: | https://www.open-access.bcu.ac.uk/id/eprint/15296 |
Actions (login required)
 |
View Item |
Tools
Tools