Hide metadata

dc.date.accessioned2024-02-22T13:03:48Z
dc.date.available2024-02-22T13:03:48Z
dc.date.issued2024
dc.identifier.urihttp://hdl.handle.net/10852/108551
dc.description.abstractThe Internet of Things (IoT) connects billions of devices with varying capacities that produce constant streams of data. Distributed stream processing systems (DSPS) are used to analyze these data streams and the processing is often performed close to the sources to optimize DSPS performance. In the highly dynamic environments created by IoT, (1) DSPSs need to adapt through updating their distribution in the form of operator migration and (2) it is very challenging to evaluate these systems through repeatable and reproducible experiments. One major contribution of this dissertation is the development of tools to simplify the evaluation of DSPSs, for example, defining experiments easily, running them on different DSPS, making fairer comparisons, and ensuring experiments can be repeated. The second main contribution is related to operator migration. This dissertation provides a novel conceptual model of operator migration in a comprehensive tutorial. Furthermore, two novel operator migration mechanisms are developed to work in geographically distributed environments. This dissertation utilizes the developed performance evaluation tools to compare the operator migration mechanisms with state-of-the-art operator migration mechanisms and demonstrate the advantages of the new mechanisms.en_US
dc.language.isoenen_US
dc.relation.haspartPaper I: Espen Volnes, Stein Kristiansen, and Thomas Plagemann. 2021. Improving the accuracy of timing in scalable WSN simulations with communicationsoftware execution models. Computer Networks, volume 188, 2021, 107855. doi:10.1016/j.comnet.2021.107855. The article is included in the thesis. The published version is available at: https://doi.org/10.1016/j.comnet.2021.107855
dc.relation.haspartPaper II: Espen Volnes, Stein Kristiansen, Thomas Plagemann, Vera Goebel, and Morten Lindeberg. 2019. Modeling the Software Execution of CEP in DCEP-Sim. In Proceedings of the 13th ACM International Conference on Distributed and Event-based Systems (DEBS ’19). Association for Computing Machinery, New York, NY, USA, 244–247. doi:10.1145/3328905.3332508. The article is included in the thesis. The published version is available at: https://doi.org/10.1145/3328905.3332508
dc.relation.haspartPaper III: Espen Volnes, Thomas Plagemann, Vera Goebel, and Stein Kristiansen. 2020. EXPOSE: Experimental performance evaluation of stream processing engines made easy. Technology Conference on Performance Evaluation and Benchmarking. Cham: Springer International Publishing, 2020. doi:10.1007/978-3-030-84924-5_2. The article is included in the thesis. The published version is available at: https://doi.org/10.1007/978-3-030-84924-5_2
dc.relation.haspartPaper IV: Espen Volnes, Thomas Plagemann, and Vera Goebel. 2023. To Migrate or not to Migrate: An Analysis of Operator Migration in Distributed Stream Processing. IEEE Communications Surveys & Tutorials, doi: 10.1109/COMST.2023.3330953. An earlier version is included in the thesis. The published version is available at: https://doi.org/10.1109/COMST.2023.3330953
dc.relation.haspartPaper V: Espen Volnes, Thomas Plagemann, Boris Koldehofe, and Vera Goebel. 2022. Travel light: state shedding for efficient operator migration. In Proceedings of the 16th ACM International Conference on Distributed and Event-Based Systems (DEBS ’22). Association for Computing Machinery, New York, NY, USA, 79–84. doi:10.1145/3524860.3539638. The article is included in the thesis. The published version is available at: https://doi.org/10.1145/3524860.3539638
dc.relation.haspartPaper VI: Espen Volnes, Thomas Plagemann, Vera Goebel, and Boris Koldehofe. 2023. Lazy Migration: Just-In-Time State Migration For Distributed Stream Processing. The paper is not available in DUO awaiting publishing.
dc.relation.urihttps://doi.org/10.1016/j.comnet.2021.107855
dc.relation.urihttps://doi.org/10.1145/3328905.3332508
dc.relation.urihttps://doi.org/10.1007/978-3-030-84924-5_2
dc.relation.urihttps://doi.org/10.1109/COMST.2023.3330953
dc.relation.urihttps://doi.org/10.1145/3524860.3539638
dc.titleDistributed Stream Processing: Performance Evaluation and Enhanced Operator Migrationen_US
dc.typeDoctoral thesisen_US
dc.creator.authorVolnes, Espen
dc.type.documentDoktoravhandlingen_US


Files in this item

Appears in the following Collection

Hide metadata