لطفا منتظر بمانید ...
0% Complete
English
صفحه اصلی
/
شانزدهمین کنفرانس بین المللی فناوری اطلاعات و دانش
An LLM-Based Approach for Clarifying the Decisions of Vision Models in Autonomous Vehicles
نویسندگان :
Omid Mosalmani
1
Mohammad Javad Rashti
2
Seyed Enayat Alavi
3
1- دانشگاه شهید چمران اهواز
2- دانشگاه شهید چمران اهواز
3- دانشگاه شهید چمران اهواز
کلمات کلیدی :
Explainable AI،Prompt Engineering،Large Language Models،Autonomous Vehicles،Textual Explanation
چکیده :
With the increasing utilization of autonomous vehicles, the transparency and explainability of their decisions have become crucial for gaining user trust and enhancing road safety. Current textual explanation methods rely on limited datasets, leading to repetitive and superficial explanations. This research presents a hybrid system where the ADAPT decision-making model is used to predict driving actions, and its attention maps serve as an interface between visual data and the explanation module. Subsequently, large language models, from the Gemini and GPT families, receive the final decision, the attention map, and a carefully designed prompt to generate concise and understandable textual explanations. The primary innovation of this approach lies in combining the decision-making model with LLMs, leveraging their extensive knowledge beyond the constraints of training data to enable the generation of more precise and diverse explanations. The system is evaluated on the BDD-X dataset and measured against standard captioning metrics including BLEU-4, METEOR, ROUGE-L, CIDEr-D, and SPICE. The evaluation results indicate the superiority of explanation outputs in our system, compared to the baseline ADAPT, particularly in multi-reference scenarios, providing more fluent and contextually rich explanations. For instance, the output acquired from Gemini 2.5 Pro model achieves a METEOR score of approximately 19.45, a significant improvement of about 28 percent compared to 15.2 for ADAPT. Furthermore, supplementary experiments show that using a contour representation of the attention map and fine-tuning the models lead to increased visual-textual consistency and result stability. In summary, by linking the visual attention of the decision-making model to the linguistic capabilities of LLMs, this research takes a step toward developing more explainable and trustworthy autonomous vehicles.
لیست مقالات
لیست مقالات بایگانی شده
خوشه بندی مقید داده ها به کمک اتوماتای یادگیر سلولی
شکوفه علی محمدی - احمدعلی آبین
Classical-Quantum Multiple Access Wiretap Channel with Common Message: One-shot Rate Region
Hadi Aghaee - Dr Bahareh Akhbari
طراحی نرم افزاری مبتنی بر واقعیت افزوده با کاربرد فروش عینک
مینا علیانژاد - نسترن زنجانی - زهرا عسکری نژاد امیری
تحلیل کتابسنجی از مقالات حوزه دوقلوهای دیجیتال
فاطمه مکی زاده - سارا صراف - مصطفی شیرالی
ارائه یک الگوریتم سلسله مراتبی جهت تشخیص نفوذ در شبکه های کامپیوتری
دکتر باقر رحیم پور کامی - سیدمحمد سیدی برشی باقر رحیم پور کامی - سیدمحمد سیدی برشی -
Target-driven Navigation of a Mobile Robot using an End-to-end Deep Learning Approach
Mohammad Matin Hosni - Ali Kheiri - Esmaeil Najafi
UltraLearn: Next-Generation CyberSecurity Learning Platform
Saeed Raisi - Saeid Ghasemshirazi - Ghazaleh Shirvani
ParsEL 1.0: Unsupervised Entity Linking in Persian Social Media Texts
Majid Asgari-bidhendi - Farzane Fakhrian - Dr Behrouz Minaei-bidgoli
ارائه یک سیستم توصیهگر آگاه به زمینه مبتنی بر رفتار کاربر در شبکه اجتماعی با استفاده از پیامهای برچسب شده جغرافیایی
زهرا امینی - سید علیرضا هاشمی گلپایگانی - علی میرزائی
Exploring the Relationship Between Gameplay Log Data and Depression & Anxiety
Soroush Elyasi - Arya Varasteh Nezhad - Fattaneh Taghiyareh
بیشتر
ثمین همایش، سامانه مدیریت همایش ها و جشنواره ها - نگارش 45.0.1