Performance analysis of coupling scheduler for mapreduce/hadoop

J Tan, X Meng, L Zhang - 2012 Proceedings IEEE INFOCOM, 2012 - ieeexplore.ieee.org
For MapReduce/Hadoop, map and reduce phases exhibit fundamentally distinguishing
characteristics. Additionally, these two phases admit complicated and tight dependency on …

Coupling task progress for mapreduce resource-aware scheduling

J Tan, X Meng, L Zhang - 2013 Proceedings IEEE INFOCOM, 2013 - ieeexplore.ieee.org
Schedulers are critical in enhancing the performance of MapReduce/Hadoop in presence of
multiple jobs with different characteristics and performance goals. Though current …

Coupling scheduler for mapreduce/hadoop

J Tan, X Meng, L Zhang - … of the 21st international symposium on High …, 2012 - dl.acm.org
Current schedulers of MapReduce/Hadoop are quite successful in providing good
performance. However improving spaces still exist: map and reduce tasks are not jointly …

Omo: Optimize mapreduce overlap with a good start (reduce) and a good finish (map)

J Wang, Y Yao, Y Mao, B Sheng… - 2015 IEEE 34th …, 2015 - ieeexplore.ieee.org
MapReduce has become a popular data processing framework in the past few years.
Scheduling algorithm is crucial to the performance of a MapReduce cluster, especially when …

Dreams: Dynamic resource allocation for mapreduce with data skew

Z Liu, Q Zhang, MF Zhani, R Boutaba… - 2015 IFIP/IEEE …, 2015 - ieeexplore.ieee.org
MapReduce has become a popular model for large-scale data processing in recent years.
However, existing MapRe-duce schedulers still suffer from an issue known as partitioning …

A hybrid scheduling algorithm for data intensive workloads in a mapreduce environment

P Nguyen, T Simon, M Halem… - 2012 IEEE Fifth …, 2012 - ieeexplore.ieee.org
The specific choice of workload task schedulers for Hadoop MapReduce applications can
have a dramatic effect on job workload latency. The Hadoop Fair Scheduler (FairS) assigns …

Workload characteristic oriented scheduler for mapreduce

P Lu, YC Lee, C Wang, BB Zhou… - 2012 IEEE 18th …, 2012 - ieeexplore.ieee.org
Applications in many areas are increasingly developed and ported using the Map Reduce
framework (more specifically, Hadoop) to exploit (data) parallelism. The application scope of …

Dynamic resource allocation for MapReduce with partitioning skew

Z Liu, Q Zhang, R Ahmed, R Boutaba… - IEEE Transactions on …, 2016 - ieeexplore.ieee.org
MapReduce has become a prevalent programming model for building data processing
applications in the cloud. While being widely used, existing MapReduce schedulers still …

MTSD: A task scheduling algorithm for MapReduce base on deadline constraints

Z Tang, J Zhou, K Li, R Li - 2012 IEEE 26th International …, 2012 - ieeexplore.ieee.org
The previous works about MapReduce task scheduling with deadline constraints neither
take the diffenences of Map and Reduce task, nor the cluster's heterogeneity into account …

Automatic task re-organization in MapReduce

Z Guo, M Pierce, G Fox, M Zhou - 2011 IEEE International …, 2011 - ieeexplore.ieee.org
MapReduce is increasingly considered as a useful parallel programming model for large-
scale data processing. It exploits parallelism among execution of primitive map and reduce …