标题：SLO-driven task scheduling in MapReduce environments
作者：Wang, Jie ;Li, Qingzhong ;Shi, Yuliang
作者机构：[Wang, Jie ;Li, Qingzhong ;Shi, Yuliang ] School of Computer Science and Technology, Shandong University, Jinan, China
会议名称：2013 10th Web Information System and Application Conference, WISA 2013
会议日期：1 November 2013 through 3 November 2013
来源：Proceedings - 2013 10th Web Information System and Application Conference, WISA 2013
关键词：Hadoop; MapReduce; performance management; SLO; task scheduling
摘要：MapReduce is emerging as an important programming model for massive data processing. A key challenge in MapReduce environments is the ability to efficiently control resource allocation and task scheduling for achieving Service Level Objectives (SLOs) of MapReduce jobs. However, there are few effective task scheduling methods to guarantee MapReduce jobs' SLOs. Therefore, we address this challenge by proposing a SLO-driven task scheduling mechanism in this paper. Based on the MapReduce performance model we build, our mechanism dynamically adjusts resource allocation and task scheduling in order to guarantee the SLOs of jobs and improve global job utility. Experimental results show that our SLO-driven task scheduler effectively meets the specified job latency SLOs and enhances job utility on tested MapReduce programs. © 2013 IEEE.