Towards distributed machine learning in shared clusters: A dynamically-partitioned approach

P Sun, Y Wen, NBD Ta, S Yan - 2017 IEEE International …, 2017 - ieeexplore.ieee.org
Many cluster management systems (CMSs) have been proposed to share a single cluster
with multiple distributed computing systems. However, none of the existing approaches can
handle distributed machine learning (ML) workloads given the following criteria: high
resource utilization, fair resource allocation and low sharing overhead. To solve this
problem, we propose a new CMS named Dorm, incorporating a dynamically-partitioned
cluster management mechanism and an utilization-fairness optimizer. Specifically, Dorm …

[PDF][PDF] Towards distributed machine learning in shared clusters: A dynamically-partitioned approach.(2017)

P SUN, Y WEN, NBD TA, S YAN - Proceedings of the 2017 IEEE … - ink.library.smu.edu.sg
Many cluster management systems (CMSs) have been proposed to share a single cluster
with multiple distributed computing systems. However, none of the existing approaches can
handle distributed machine learning (ML) workloads given the following criteria: high
resource utilization, fair resource allocation and low sharing overhead. To solve this
problem, we propose a new CMS named Dorm, incorporating a dynamicallypartitioned
cluster management mechanism and an utilizationfairness optimizer. Specifically, Dorm …
以上显示的是最相近的搜索结果。 查看全部搜索结果