Adaptable I/O System based I/O Reduction for Improving the Performance of HDFS

التفاصيل البيبلوغرافية
العنوان: Adaptable I/O System based I/O Reduction for Improving the Performance of HDFS
المؤلفون: Jung Kyu Park, Sungmin Koo, Jaeho Kim, Seungjae Baek
المصدر: JSTS:Journal of Semiconductor Technology and Science. 16:880-888
بيانات النشر: The Institute of Electronics Engineers of Korea, 2016.
سنة النشر: 2016
مصطلحات موضوعية: Reduction (complexity), Java Native Interface, business.industry, Semantics (computer science), Computer science, Computer data storage, Operating system, Electrical and Electronic Engineering, business, computer.software_genre, computer, Computer hardware, Electronic, Optical and Magnetic Materials
الوصف: In this paper, we propose a new HDFS-AIO framework to enhance HDFS with Adaptive I/O System (ADIOS), which supports many different I/O methods and enables applications to select optimal I/O routines for a particular platform without source-code modification and re-compilation. First, we customize ADIOS into a chunk-based storage system so its API semantics can fit the requirement of HDFS easily; then, we utilize Java Native Interface (JNI) to bridge HDFS and the tailored ADIOS. We use different I/O patterns to compare HDFS-AIO and the original HDFS, and the experimental results show the design feasibility and benefits. We also examine the performance of HDFS-AIO using various I/O techniques. There have been many studies that use ADIOS, however our research is expected to help in expanding the function of HDFS.
تدمد: 1598-1657
الوصول الحر: https://explore.openaire.eu/search/publication?articleId=doi_________::fdf99550aefe3cd85938f02315dba611Test
https://doi.org/10.5573/jsts.2016.16.6.880Test
حقوق: OPEN
رقم الانضمام: edsair.doi...........fdf99550aefe3cd85938f02315dba611
قاعدة البيانات: OpenAIRE