Research Article
Survey on Task Assignment Techniques in Hadoop
|
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
|
| Volume 59 - Issue 14 |
| Published: December 2012 |
| Authors: Sarika Patil, Shyam Deshmukh |
10.5120/9617-4256
|
Sarika Patil, Shyam Deshmukh . Survey on Task Assignment Techniques in Hadoop. International Journal of Computer Applications. 59, 14 (December 2012), 15-18. DOI=10.5120/9617-4256
@article{ 10.5120/9617-4256,
author = { Sarika Patil,Shyam Deshmukh },
title = { Survey on Task Assignment Techniques in Hadoop },
journal = { International Journal of Computer Applications },
year = { 2012 },
volume = { 59 },
number = { 14 },
pages = { 15-18 },
doi = { 10.5120/9617-4256 },
publisher = { Foundation of Computer Science (FCS), NY, USA }
}
%0 Journal Article
%D 2012
%A Sarika Patil
%A Shyam Deshmukh
%T Survey on Task Assignment Techniques in Hadoop%T
%J International Journal of Computer Applications
%V 59
%N 14
%P 15-18
%R 10.5120/9617-4256
%I Foundation of Computer Science (FCS), NY, USA
Abstract
MapReduce is an implementation for processing large scale data parallelly. Actual benefits of MapReduce occur when this framework is implemented in large scale, shared nothing cluster. MapReduce framework abstracts the complexity of running distributed data processing across multiple nodes in cluster. Hadoop is open source implementation of MapReduce framework, which processes the vast amount of data in parallel on large clusters. In Hadoop pluggable scheduler was implemented, because of this several algorithms have been developed till now. This paper presents the different schedulers used for Hadoop.
References
- Hadoop http://hadoop. apache. org/
- Jeffrey Dean and Sanjay Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters, "In Communications of the ACM, Volume 51, Issue 1, pp. 107-113, 2008. J. Clerk Maxwell, A Treatise on Electricity and Magnetism, 3rd ed. , vol. 2. Oxford: Clarendon,1892, pp. 68–73.
- B. Thirumala Rao and Dr. L. S. S. Reddy,"Survey on Improved Scheduling in Hadoop MapReduce in Cloud Environments "
- Matei Zaharia, "The Hadoop Fair Scheduler" http://developer. yahoo. net/blogs/hadoop/FairSharePres. ppt.
- Hadoop's Capacity Scheduler, http://hadoop. apache. org/core/docs/current/capacity_scheduler. html.
- Matei Zaharia, Dhruba Borthakur, Joydeep Sen Sarma, Khaled Elmeleely, Scott Shenker and Ion Stoica, "Delay Scheduling: A Simple Technique For Achieving Locality and Fairness in Cluster Scheduling"
- Thomas Sandholm and Kevin Lai. Dynamic proportional share scheduling in hadoop. In JSSPP '10: 15th Workshop on Job Scheduling Strategies for Parallel Processing, April,2010
- K. Kc and K. Anyanwu, "Scheduling Hadoop Jobs to Meet Deadlines", in Proc. CloudCom, 2010, pp. 388-392.
- Mark Yong, Nitin Garegrat, Shiwali Mohan: "Towards a Resource Aware Scheduler in Hadoop" in Proc. ICWS, 2009, pp:102-109
- Jaideep Dhok and Vasudeva varma," Using Pattern Classification for Task Assignment in MapReduce"
- Jaideep Dhok, Nitesh Maheshwari and Vasudeva Varma,"Learning Based Opportunistic Admission Control Algorithm for MapReduce as a Service"
- Amazon Elastic Compute Cloud. http://aws. amazon. com/ec2/.
Index Terms
Keywords