Communication-efficient processing of multiple continuous aggregate queries

Cited 1 time in webofscience Cited 2 time in scopus
  • Hit : 660
  • Download : 0
Recently, great attention has been paid to distributed stream processing systems (DSPSs), where a number of distributed source nodes generate data streams and queries are continuously executed over those streams. An emerging challenge in large-scale DSPSs is to efficiently process multiple continuous aggregate queries. To process a continuous aggregate query, each source node periodically sends partial aggregates computed over its local stream to the sink node, where the final results are computed. Since sending partial aggregates for each query separately can lead to significant communication overhead, lowering the overall performance and scalability, multiple aggregate queries must be processed collectively, rather than separately. In this paper, we propose an efficient method for collectively processing multiple continuous aggregate queries, which minimizes the total communication costs from source nodes to the sink node. The proposed method finds the smallest set of partial aggregates that each source node needs to send to the sink node to correctly answer all the queries, and thus minimizes the number of message transmissions. Furthermore, since the proposed method operates on-the-fly, it can efficiently handle registration or deregistration of queries at any time. Through theoretical analysis and experiments, we show that the proposed method outperforms the existing ones in terms of communication costs.
Publisher
ELSEVIER SCIENCE INC
Issue Date
2014-11
Language
English
Article Type
Article
Citation

INFORMATION SCIENCES, v.284, no.Special SI, pp.1 - 17

ISSN
0020-0255
DOI
10.1016/j.ins.2014.06.044
URI
http://hdl.handle.net/10203/191075
Appears in Collection
CS-Journal Papers(저널논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 1 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0