标题:SLO-driven task scheduling in MapReduce environments
作者:Wang, Jie ;Li, Qingzhong ;Shi, Yuliang
通讯作者:Li, Q
作者机构:[Wang, Jie ;Li, Qingzhong ;Shi, Yuliang ] School of Computer Science and Technology, Shandong University, Jinan, China
会议名称:2013 10th Web Information System and Application Conference, WISA 2013
会议日期:1 November 2013 through 3 November 2013
来源:Proceedings - 2013 10th Web Information System and Application Conference, WISA 2013
出版年:2013
页码:308-313
DOI:10.1109/WISA.2013.64
关键词:Hadoop; MapReduce; performance management; SLO; task scheduling
摘要:MapReduce is emerging as an important programming model for massive data processing. A key challenge in MapReduce environments is the ability to efficiently control resource allocation and task scheduling for achieving Service Level Objectives (SLOs) of MapReduce jobs. However, there are few effective task scheduling methods to guarantee MapReduce jobs' SLOs. Therefore, we address this challenge by proposing a SLO-driven task scheduling mechanism in this paper. Based on the MapReduce performance model we build, our mechanism dynamically adjusts resource allocation and task scheduling in order to guarantee the SLOs of jobs and improve global job utility. Experimental results show that our SLO-driven task scheduler effectively meets the specified job latency SLOs and enhances job utility on tested MapReduce programs. © 2013 IEEE.
收录类别:EI;SCOPUS
Scopus被引频次:1
资源类型:会议论文;期刊论文
原文链接:https://www.scopus.com/inward/record.uri?eid=2-s2.0-84899086027&doi=10.1109%2fWISA.2013.64&partnerID=40&md5=94af3599e0ca8d8b0d898e312db10d8b
TOP