Indian Journal of Science and Technology
Year: 2015, Volume: 8, Issue: 18, Pages: 1-8
Kyoo-sung Noh1 and Doo-sik Lee2*
Bigdata software platform technology using Hadoop Ecosystem is the essential element and also underlying technology for application software or service implementation of bigdata analysis. It is required to have bigdata platform technology that can ensure the scalability, reliability and high performance of system for processing and analyzing a variety of bigdata related tasks including structured data, unstructured data, semi-structured data, etc. Bigdata platform can process large amounts of data in parallel unlike those conventional application software solutions and it is an easily scalable system. Its technical components include collection (Flume and Sqoop), storage (Hadoop and NoSQL), search (Solr), analysis (R Analysis), visualization (Node.js), scheduler (Oozie), etc. The purpose of this study is to propose an optimized bigdata platform implementation model through S/W configuration based on open source.
Keywords: Bigdata, Bigdata Visualization, Flume, Hadoop, MAP/REDUCE, Oozie, Platform, R Analysis, Sqoop, SQL on Hadoop
Subscribe now for latest articles and news.