MXDAG: A Hybrid Abstraction for Emerging Applications

W Wang, S Das, XC Wu, Z Wang, A Chen… - Proceedings of the 20th …, 2021 - dl.acm.org
Proceedings of the 20th ACM Workshop on Hot Topics in Networks, 2021dl.acm.org
Emerging distributed applications, such as microservices, machine learning, big data
analysis, consist of both compute and network tasks. DAG-based abstraction primarily
targets compute tasks and has no explicit network-level scheduling. In contrast, Coflow
abstraction collectively schedules network flows among compute tasks but lacks the end-to-
end view of the application DAG. Because of the dependencies and interactions between
these two types of tasks, it is sub-optimal to only consider one of them. We argue that co …
Emerging distributed applications, such as microservices, machine learning, big data analysis, consist of both compute and network tasks. DAG-based abstraction primarily targets compute tasks and has no explicit network-level scheduling. In contrast, Coflow abstraction collectively schedules network flows among compute tasks but lacks the end-to-end view of the application DAG. Because of the dependencies and interactions between these two types of tasks, it is sub-optimal to only consider one of them. We argue that co-scheduling of both compute and network tasks can help applications towards the globally optimal end-to-end performance. However, none of the existing abstractions can provide fine-grained information for co-scheduling. We propose MXDAG, an abstraction to treat both compute and network tasks explicitly. It can capture the dependencies and interactions of both compute and network tasks leading to improved application performance.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果