Adaptable I/O System based I/O Reduction for Improving the Performance of HDFS
العنوان: | Adaptable I/O System based I/O Reduction for Improving the Performance of HDFS |
---|---|
المؤلفون: | Jung Kyu Park, Sungmin Koo, Jaeho Kim, Seungjae Baek |
المصدر: | JSTS:Journal of Semiconductor Technology and Science. 16:880-888 |
بيانات النشر: | The Institute of Electronics Engineers of Korea, 2016. |
سنة النشر: | 2016 |
مصطلحات موضوعية: | Reduction (complexity), Java Native Interface, business.industry, Semantics (computer science), Computer science, Computer data storage, Operating system, Electrical and Electronic Engineering, business, computer.software_genre, computer, Computer hardware, Electronic, Optical and Magnetic Materials |
الوصف: | In this paper, we propose a new HDFS-AIO framework to enhance HDFS with Adaptive I/O System (ADIOS), which supports many different I/O methods and enables applications to select optimal I/O routines for a particular platform without source-code modification and re-compilation. First, we customize ADIOS into a chunk-based storage system so its API semantics can fit the requirement of HDFS easily; then, we utilize Java Native Interface (JNI) to bridge HDFS and the tailored ADIOS. We use different I/O patterns to compare HDFS-AIO and the original HDFS, and the experimental results show the design feasibility and benefits. We also examine the performance of HDFS-AIO using various I/O techniques. There have been many studies that use ADIOS, however our research is expected to help in expanding the function of HDFS. |
تدمد: | 1598-1657 |
الوصول الحر: | https://explore.openaire.eu/search/publication?articleId=doi_________::fdf99550aefe3cd85938f02315dba611Test https://doi.org/10.5573/jsts.2016.16.6.880Test |
حقوق: | OPEN |
رقم الانضمام: | edsair.doi...........fdf99550aefe3cd85938f02315dba611 |
قاعدة البيانات: | OpenAIRE |
كن أول من يترك تعليقا!