کنفرانس بین المللی فناوری اطلاعات و دانش

صفحه اصلی / پانزدهمین کنفرانس بین المللی فناوری اطلاعات و دانش

Leveraging Retrieval-Augmented Generation for Persian University Knowledge Retrieval

نویسندگان :

Arshia Hemmat¹ Mohammad Hassan Heydari² Kianoosh Vadaei³ Afsaneh Fatemi⁴

1- University of Isfahan 2- University of Isfahan 3- University of Isfahan 4- University of Isfahan

کلمات کلیدی :

Large Language Models،Natural Language Processing،Retrieval Augmented Generation،Dataset Generation،QuestionAnswering System

چکیده :

This paper introduces an innovative approach using Retrieval-Augmented Generation (RAG) pipelines with Large Language Models (LLMs) to enhance information retrieval and query response systems for university-related question answering. By systematically extracting data from the university's official website, primarily in Persian, and employing advanced prompt engineering techniques, we generate accurate and contextually relevant responses to user queries. We developed a comprehensive university benchmark, UniversityQuestionBench (UQB), to rigorously evaluate our system’s performance. UQB focuses on Persian-language data, assessing accuracy and reliability through various metrics and real-world scenarios. Our experimental results demonstrate significant improvements in the precision and relevance of generated responses, enhancing user experiences, and reducing the time required to obtain relevant answers. In summary, this paper presents a novel application of RAG pipelines and LLMs for Persian-language data retrieval, supported by a meticulously prepared university benchmark, offering valuable insights into advanced AI techniques for academic data retrieval and setting the stage for future research in this domain.\footnote{Dataset is publicly available at \url{https://huggingface.co/datasets/UIAIC/UQB}}