Network monitoring as a streaming analytics problem

A Gupta, R Birkner, M Canini, N Feamster… - Proceedings of the 15th …, 2016 - dl.acm.org
Proceedings of the 15th ACM workshop on hot topics in networks, 2016dl.acm.org
Programmable switches potentially make it easier to perform flexible network monitoring
queries at line rate, and scalable stream processors make it possible to fuse data streams to
answer more sophisticated queries about the network in real-time. However, processing
such network monitoring queries at high traffic rates requires both the switches and the
stream processors to filter the traffic iteratively and adaptively so as to extract only that traffic
that is of interest to the query at hand. While the realization that network monitoring is a …
Programmable switches potentially make it easier to perform flexible network monitoring queries at line rate, and scalable stream processors make it possible to fuse data streams to answer more sophisticated queries about the network in real-time. However, processing such network monitoring queries at high traffic rates requires both the switches and the stream processors to filter the traffic iteratively and adaptively so as to extract only that traffic that is of interest to the query at hand. While the realization that network monitoring is a streaming analytics problem has been made earlier, our main contribution in this paper is the design and implementation of Sonata, a closed-loop system that enables network operators to perform streaming analytics for network monitoring applications at scale. To achieve this objective, Sonata allows operators to express a network monitoring query by considering each packet as a tuple. More importantly, Sonata allows them to partition the query across both the switches and the stream processor, and through iterative refinement, Sonata's runtime attempts to extract only the traffic that pertains to the query, thus ensuring that the stream processor can scale to satisfy a large number of queries for traffic at very high rates. We show with a simple example query involving DNS reflection attacks and traffic traces from one of the world's largest IXPs that Sonata can capture 95% of all traffic pertaining to the query, while reducing the overall data rate by a factor of about 400 and the number of required counters by four orders of magnitude.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果