0% Complete
فارسی
Home
/
چهاردهمین کنفرانس بین المللی فناوری اطلاعات و دانش
Improving Training Stability in Variational Autoencoders Through the Integration of Score Matching Loss
Authors :
Amirreza Mokhtari Rad
1
Pouya Ardehkhani
2
Hormehr Alborzi
3
1- پردیس فارابی دانشگاه تهران
2- پردیس فارابی دانشگاه تهران
3- پردیس فارابی دانشگاه تهران
Keywords :
Variational Auto Encoder،Training،Stability،Generative Models،Score Matching
Abstract :
In this research, a Variational Autoencoder (VAE) model was developed, and the CIFAR100 dataset was employed as the primary data source. The problem addressed pertained to the instability in the training process of VAE models. To mitigate this issue, various loss expressions were explored, including the use of score matching loss independently, in conjunction with total variation loss, and in combination with reconstruction loss. The innovative approach revealed that when score matching loss was integrated either with total variation loss or when applied as a standalone loss function, the training process exhibited increased stability. This was evident through smoother loss curves and latent space visualizations that displayed characteristics akin to a normal distribution. As a consequence, this novel approach promises the potential for building more stable generative models, which can significantly enhance the overall training process in VAEs. This innovation provides a valuable contribution to the field of generative modeling, with the prospect of addressing the longstanding challenge of training stability in VAEs, thereby opening avenues for more efficient and effective model development and application.
Papers List
List of archived papers
Enhancing Software Effort Estimation with an Integrated Approach of Particle Swarm Optimization and Genetic Algorithms in Analogy-based Method
Ehsan Nasr - Keyvan Mohebbi
Improving Fog Computing Scalability in Software Defined Network using Critical Requests Prediction in IoT
Hajar Ghanbari
پیشبینی بستری مجدد بیماران با استفاده از استخراج مفاهیم زیستپزشکی از متون بالینی
فهیمه شاهرخ شهرکی - رسول سامانی - دکتر ناصر قدیری فهیمه شاهرخ شهرکی - رسول سامانی - ناصر قدیری -
A Swarm Intelligence Approach to Design Optimal Repeaters in Multilayer Graphene Nanoribbon Interconnects
Majid Sanaeepur - Maryam Momeni
A Comparative Evaluation of Machine Learning Models for Anomaly-Based IDS in IoT Networks
Seyed Amir Mousavi - Mostafa Sadeghi - Mohammad Sadeq Sirjani
سیستم پیشنهاددهنده غذای سالم با استفاده از داده کاوی عادت های تغذیه ای کاربران
محمد عباسی - مریم حسینی پزوه - محمدرضا شمس
Improving Personalized Federated Learning-based QoE Assessment using Clustering
Skokufe Motaharipour - Behrouz Shahgholi Ghahfarokhi - Saeid Afshari
ارائه یک سیستم توصیهگر آگاه به زمینه مبتنی بر رفتار کاربر در شبکه اجتماعی با استفاده از پیامهای برچسب شده جغرافیایی
زهرا امینی - سید علیرضا هاشمی گلپایگانی - علی میرزائی
Simulanteus Load Balancing of Servers and Controllers in SDN-based IoMT
Somaye Imanpour - Ahmadreza Montazerolghaem - Saeed Afahari
A method for image steganography based on chaotic maps and advanced compression algorithms
Mohammad Yousefi Sorkhi
more
Samin Hamayesh - Version 41.3.1