Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Optimized Analytics Query Allocation at the Edge of the Network

  • Conference paper
  • First Online:
Internet and Distributed Computing Systems (IDCS 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11874))

Included in the following conference series:

Abstract

The new era of the Internet of Things (IoT) provides the space where novel applications will play a significant role in people’s daily lives through the adoption of multiple services that facilitate everyday activities. The huge volumes of data produced by numerous IoT devices make the adoption of analytics imperative to produce knowledge and support efficient decision making. In this setting, one can identify two main problems, i.e., the time required to send the data to Cloud and wait for getting the final response and the distributed nature of data collection. Edge Computing (EC) can offer the necessary basis for storing locally the collected data and provide the required analytics on top of them limiting the response time. In this paper, we envision multiple edge nodes where data are stored being the subject of analytics queries. We propose a methodology for allocating queries, defined by end users or applications, to the appropriate edge nodes in order to save time and resources in the provision of responses. By adopting our scheme, we are able to ask the execution of queries only from a sub-set of the available nodes avoiding to demand processing activities that will lead to an increased response time. Our model envisions the allocation to specific epochs and manages a batch of queries at a time. We present the formulation of our problem and the proposed solution while providing results of an extensive evaluation process that reveals the pros and cons of the proposed model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://archive.ics.uci.edu/ml/datasets/Energy+efficiency.

  2. 2.

    https://archive.ics.uci.edu/ml/datasets/Optical+Interconnection+Network+.

References

  1. Apiletti, D., et al.: Frequent itemsets mining for big data: a comparative analysis. Big Data Res. 9, 67–83 (2017)

    Article  Google Scholar 

  2. Bangui, H., et al.: Moving to the edge-cloud-of-things: recent advances and future research directions. Electronics 7, 309 (2018)

    Article  Google Scholar 

  3. Bowden, D., et al.: A cloud-to-edge architecture for predictive analytics. In: Workshops of the EDBT/ICDT Conference (2019)

    Google Scholar 

  4. Chai, Z., et al.: Towards taming the resource and data heterogeneity in federated learning. In: USENIX Conference on Operational Machine Learning (2019)

    Google Scholar 

  5. Chandramouli, B., Goldstein, J., Quamar, A.: Scalable progressive analytics on big data in the cloud. VLDB Endow. 6(14), 1726–1737 (2013)

    Article  Google Scholar 

  6. Chatterjea, S., Havunga, P.: A taxonomy of distributed query management techniques for wireless sensor networks. IJCS 20(7), 889–908 (2007)

    Google Scholar 

  7. Chen, Y., Zhu, F., Lee, J.: Data quality evaluation and improvement for prognostic modeling using visual assessment based data partitioning method. Comput. Ind. 64(3), 214–225 (2013)

    Article  Google Scholar 

  8. Condie, T., et al.: MapReduce online. In: The 7th Conference on Networked Systems Design and Implementation (2010)

    Google Scholar 

  9. Cummins, R., et al.: A Polya urn document language model for improved information retrieval. ACM TIS 9(4), 21 (2010)

    Google Scholar 

  10. Hellerstein, J.M., Avnur, R.: Informix under CONTROL: online query processing. Data Min. Knowl. Discovery J. 4, 281–314 (2000)

    Article  Google Scholar 

  11. Huang, Z., Zhong, A., Li, G.: On-demand processing for remote sensing big data analysis. In: IEEE ISPDPA (2017)

    Google Scholar 

  12. Jermaine, C., et al.: Scalable approximate query processing with the DBO engine. In: SIGMOD (2007)

    Google Scholar 

  13. Khan, W., et al.: Edge computing: a survey. FGCS 97, 219–235 (2019)

    Article  Google Scholar 

  14. Kolomvatsos, K., Anagnostopoulos, C.: Multi-criteria optimal task allocation at the edge. FGCS 93, 358–372 (2019)

    Article  Google Scholar 

  15. Kolomvatsos, K., Anagnostopoulos, C.: An edge-centric ensemble scheme for queries assignment. In: 8th CIMA Workshop (2018)

    Google Scholar 

  16. Kolomvatsos, K.: An intelligent scheme for assigning queries. Appl. Intell. 48, 2730–2745 (2018)

    Article  Google Scholar 

  17. Kolomvatsos, K., Anagnostopoulos, C.: Reinforcement machine learning for predictive analytics in smart cities. Informatics 4, 16 (2017)

    Article  Google Scholar 

  18. Kolomvatsos, K., Hadjiefthymiades, S.: Learning the engagement of query processors for intelligent analytics. Appl. Intell. 46, 96–112 (2017)

    Article  Google Scholar 

  19. Logothetis, D., Yocum, K.: Ad-hoc data processing in the cloud. VLDB Endow. 1(2), 1472–1475 (2008)

    Article  Google Scholar 

  20. Munkres, J.: Algorithms for the assignment and transportation problems. JSIAM 5(1), 32–38 (1957)

    MathSciNet  MATH  Google Scholar 

  21. Murphree, J.: Machine learning anomaly detection in large systems. In: IEEE AUTOTESTCON, pp. 1–9 (2016)

    Google Scholar 

  22. Phansalkar, S., Ahirrao, S.: Survey of data partitioning algorithms for big data stores. In: 4th ICPDGC (2016)

    Google Scholar 

  23. Yu, W., et al.: A survey on the edge computing for the Internet of Things. IEEE Access 6, 6900–6919 (2017)

    Article  Google Scholar 

Download references

Acknowledgment

This research received funding from the European’s Union Horizon 2020 research and innovation programme under the grant agreement No. 745829 & the Greek Secretariat for Research Funding under the project ENFORCE.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kostas Kolomvatsos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Karanika, A., Soula, M., Anagnostopoulos, C., Kolomvatsos, K., Stamoulis, G. (2019). Optimized Analytics Query Allocation at the Edge of the Network. In: Montella, R., Ciaramella, A., Fortino, G., Guerrieri, A., Liotta, A. (eds) Internet and Distributed Computing Systems . IDCS 2019. Lecture Notes in Computer Science(), vol 11874. Springer, Cham. https://doi.org/10.1007/978-3-030-34914-1_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-34914-1_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-34913-4

  • Online ISBN: 978-3-030-34914-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics