Indian Journal of Science and Technology
Year: 2016, Volume: 9, Issue: 44, Pages: 1-8
C. Sreedhar1*, N. Kasiviswanath1 and P.Chenna Reddy2
1Department of Computer Science and Engineering, G Pulla Reddy Engineering College, Kurnool - 518007,Andhra Pradesh, India; [email protected], [email protected] 2Department of Computer Science and Engineering, JNT University Anantapur, Anantapuram - 515002,Andhra Pradesh, India; [email protected]
*Author for correspondence
Department of Computer Science and Engineering, G Pulla Reddy Engineering College, Kurnool - 518007,Andhra Pradesh, India; [email protected]
Objectives: In this paper, we discuss on the importance of multilevel queues in scheduling Hadoopmapreduce jobs. Methods/Statistical analysis: Modifications are done on HDFS and yarn configuration files to suit the multilevel queues. This work constitutes the performance analysis of various existing job schedulers such as FIFO, Fair and Capacity schedulers.Findings:Significant achievements are achieved which includes performance evaluation metrics for comparative understanding of the proposed and existing techniques. The final outcome of the work demonstrates the need for multilevel queue scheduling with allocation policies and the optimal placement of jobs in queues.Application/ Improvements:With the adoption of multilevel queue scheduling, there is a significant improvement in placing jobs in multilevel queues for the jobs submitted by the users.
Keywords:Capacity,Fair, FIFO, Hadoop, Mapreduce, Multilevel Queues
Subscribe now for latest articles and news.