Dynamic routing of data stream tuples among parallel query plan running on multi-core processors

AA Safaei, A Sharifrazavian, M Sharifi… - Distributed and Parallel …, 2012 - Springer
AA Safaei, A Sharifrazavian, M Sharifi, MS Haghjoo
Distributed and Parallel Databases, 2012Springer
In this paper, a method for fast processing of data stream tuples in parallel execution of
continuous queries over a multiprocessing environment is proposed. A copy of the query
plan is assigned to each of processing units in the multiprocessing environment. Dynamic
and continuous routing of input data stream tuples among the graph constructed by these
copies (called the Query Mega Graph) for each input tuple determines that, after getting
processed by each processing unit (eg, processor), to which next processor it should be …
Abstract
In this paper, a method for fast processing of data stream tuples in parallel execution of continuous queries over a multiprocessing environment is proposed. A copy of the query plan is assigned to each of processing units in the multiprocessing environment. Dynamic and continuous routing of input data stream tuples among the graph constructed by these copies (called the Query Mega Graph) for each input tuple determines that, after getting processed by each processing unit (e.g., processor), to which next processor it should be forwarded. Selection of the proper next processor is performed such that the destination processor imposes the minimum tuple latency to the corresponding tuple, among all of the alternative processors. The tuple latency is derived from processing, buffering and communication time delay which varies in different practical parallel systems.
Parallel system architectures that would be suitable as the desired multiprocessing environment for employing the proposed Dynamic Tuple Routing (DTR) method are considered and analyzed. Also, practical challenges and issues for the proper parallel underlying system are discussed. Implementation of the desired parallel system on multi-core systems is provided and used for evaluating the proposed DTR method. Evaluation results show that the proposed DTR method outperforms similar method such as the Eddies in terms of tuple latency, throughput and tuple loss.
Springer
以上显示的是最相近的搜索结果。 查看全部搜索结果