دورية أكاديمية

Explore Deep Neural Network and Reinforcement Learning to Large-scale Tasks Processing in Big Data.

التفاصيل البيبلوغرافية
العنوان: Explore Deep Neural Network and Reinforcement Learning to Large-scale Tasks Processing in Big Data.
المؤلفون: Wu, Chunyi1,2 (AUTHOR) wucy13@mails.jlu.edu.cn, Xu, Gaochao1 (AUTHOR) xugc@jlu.edu.cn, Ding, Yan2 (AUTHOR) dingyan11@mails.jlu.edu.cn, Zhao, Jia2 (AUTHOR) zhaiyj049@sina.com
المصدر: International Journal of Pattern Recognition & Artificial Intelligence. Dec2019, Vol. 33 Issue 13, pN.PAG-N.PAG. 29p.
مصطلحات موضوعية: *ARTIFICIAL neural networks, *BIG data, *ELECTRONIC data processing, *DATA transmission systems, REINFORCEMENT learning, VIRTUAL networks, TASKS
مستخلص: Large-scale tasks processing based on cloud computing has become crucial to big data analysis and disposal in recent years. Most previous work, generally, utilize the conventional methods and architectures for general scale tasks to achieve tons of tasks disposing, which is limited by the issues of computing capability, data transmission, etc. Based on this argument, a fat-tree structure-based approach called LTDR (Large-scale Tasks processing using Deep network model and Reinforcement learning) has been proposed in this work. Aiming at exploring the optimal task allocation scheme, a virtual network mapping algorithm based on deep convolutional neural network and Q -learning is presented herein. After feature extraction, we design and implement a policy network to make node mapping decisions. The link mapping scheme can be attained by the designed distributed value-function based reinforcement learning model. Eventually, tasks are allocated onto proper physical nodes and processed efficiently. Experimental results show that LTDR can significantly improve the utilization of physical resources and long-term revenue while satisfying task requirements in big data. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Pattern Recognition & Artificial Intelligence is the property of World Scientific Publishing Company and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
قاعدة البيانات: Business Source Index
الوصف
تدمد:02180014
DOI:10.1142/S0218001419510108