CRII: OAC: AquiLLM: A knowledge-based AI tool to keep research data alive

About This Grant

The introduction of retrieval augmented generation and large language models (RAG/LLM) shows promise as a way for scientific research groups to discover and access information across platforms using natural language queries. Research groups often face challenges managing and accessing work such as paper drafts, research experiments, plots, and meeting notes, especially as these resources grow over time and researchers transition in and out of projects. This project addresses these challenges by developing AquiLLM, a RAG/LLM tool that leverages open-source models and platforms, and serves as a knowledge base for research groups by protecting private data, preserving tacit group-specific knowledge, and offering an open-source design to allow other researchers to implement and customize their systems with careful attention to cost considerations. This project benefits research groups by offering a way to use natural language to ask questions about their data, yielding links to relevant documents. AquiLLM is designed to address the challenge of securely organizing and accessing research group data using natural language queries. The system consists of a Django-based web interface connected to a vector store for indexing and retrieving data efficiently. It integrates with a large language model (LLM) to process queries and return relevant results in real-time. The project uses open-source tools to ensure adaptability and scalability while maintaining data privacy. Researchers can query private datasets, such as research papers, experimental results, plots, and meeting notes, without exposing this data to external systems. AquiLLM employs modular design principles, allowing components like LLM or vector store to be swapped or customized for specific research group needs. Its contribution lies in providing a scalable, secure, and customizable solution for integrating RAG/LLM systems into research environments. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.