دورية أكاديمية

Towards Efficient Communication Federated Recommendation System via Low-rank Training

التفاصيل البيبلوغرافية
العنوان: Towards Efficient Communication Federated Recommendation System via Low-rank Training
المؤلفون: Nguyen, Ngoc-Hieu, Nguyen, Tuan-Anh, Nguyen, Tuan, Hoang, Vu Tien, Le, Dung D., Wong, Kok-Seng
سنة النشر: 2024
المجموعة: ArXiv.org (Cornell University Library)
مصطلحات موضوعية: Computer Science - Machine Learning, Computer Science - Cryptography and Security, Computer Science - Distributed, Parallel, and Cluster Computing, Computer Science - Information Retrieval
الوصف: In Federated Recommendation (FedRec) systems, communication costs are a critical bottleneck that arises from the need to transmit neural network models between user devices and a central server. Prior approaches to these challenges often lead to issues such as computational overheads, model specificity constraints, and compatibility issues with secure aggregation protocols. In response, we propose a novel framework, called Correlated Low-rank Structure (CoLR), which leverages the concept of adjusting lightweight trainable parameters while keeping most parameters frozen. Our approach substantially reduces communication overheads without introducing additional computational burdens. Critically, our framework remains fully compatible with secure aggregation protocols, including the robust use of Homomorphic Encryption. Our approach resulted in a reduction of up to 93.75% in payload size, with only an approximate 8% decrease in recommendation performance across datasets. Code for reproducing our experiments can be found at https://github.com/NNHieu/CoLR-FedRecTest. ; Comment: 11 pages, 5 figures, 4 tables
نوع الوثيقة: text
اللغة: unknown
العلاقة: http://arxiv.org/abs/2401.03748Test
الإتاحة: http://arxiv.org/abs/2401.03748Test
رقم الانضمام: edsbas.5192A31F
قاعدة البيانات: BASE