• P-ISSN 0974-6846 E-ISSN 0974-5645

Indian Journal of Science and Technology

Article

Indian Journal of Science and Technology

Year: 2016, Volume: 9, Issue: 44, Pages: 1-8

Original Article

A Novel Multilevel Queue based Performance Analysis of Hadoop Job Schedulers

Abstract

Objectives: In this paper, we discuss on the importance of multilevel queues in scheduling Hadoopmapreduce jobs. Methods/Statistical analysis: Modifications are done on HDFS and yarn configuration files to suit the multilevel queues. This work constitutes the performance analysis of various existing job schedulers such as FIFO, Fair and Capacity schedulers.Findings:Significant achievements are achieved which includes performance evaluation metrics for comparative understanding of the proposed and existing techniques. The final outcome of the work demonstrates the need for multilevel queue scheduling with allocation policies and the optimal placement of jobs in queues.Application/ Improvements:With the adoption of multilevel queue scheduling, there is a significant improvement in placing jobs in multilevel queues for the jobs submitted by the users.

Keywords:Capacity,Fair, FIFO, Hadoop, Mapreduce, Multilevel Queues

DON'T MISS OUT!

Subscribe now for latest articles and news.