Large Language Models (LLMs) are advanced AI models trained on extensive datasets of text that have strong capabilities in determining semantic relationships between words to answer general questions. While they perform well across various domains, these models have a few common issues, particularly in the medical field. LLMs struggle with hallucinations, incorrect or misleading responses, and having outdated knowledge due to static training data. This project explores Retrieval Augmented Generation (RAG), which is a framework designed to tackle these issues. RAG enhances the performance and accuracy of LLMs by retrieving up-to-date data from external sources relevant to the user's question. It incorporates this information along with the query as input to the LLM, which generates a response based on its training set along with this additional information. Our focus is to apply this framework in the biomedical domain by utilizing RAG with datasets such as PubMedQA, which consists of biomedical question answering compiled from PubMed abstracts. This helps us achieve our goal of evaluating and improving the model's ability to answer complex biomedical questions accurately, making LLMs more practical for clinical and scientific scenarios.
Oakland University
318 Meadow Brook Rd
Rochester Hills, Michigan
48309, USA