{"id":678873,"date":"2025-07-07T06:05:13","date_gmt":"2025-07-07T03:05:13","guid":{"rendered":"https:\/\/buradabiliyorum.com\/en\/open-source-engine-enables-high-performance-data-processing-for-internet-of-things-devices\/"},"modified":"2025-07-07T06:05:13","modified_gmt":"2025-07-07T03:05:13","slug":"open-source-engine-enables-high-performance-data-processing-for-internet-of-things-devices","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/open-source-engine-enables-high-performance-data-processing-for-internet-of-things-devices\/","title":{"rendered":"Open-source engine enables high-performance data processing for Internet of Things devices"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a32e99b26845\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a32e99b26845\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/open-source-engine-enables-high-performance-data-processing-for-internet-of-things-devices\/#Built_for_the_edge\" >Built for the edge<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/open-source-engine-enables-high-performance-data-processing-for-internet-of-things-devices\/#Flexible_extensible_ready_for_production\" >Flexible, extensible, ready for production<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/open-source-engine-enables-high-performance-data-processing-for-internet-of-things-devices\/#Demos\" >Demos<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/buradabiliyorum.com\/en\/open-source-engine-enables-high-performance-data-processing-for-internet-of-things-devices\/#From_research_to_real-world_impact\" >From research to real-world impact<\/a><\/li><\/ul><\/nav><\/div>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2019\/internetofth.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2019\/internetofth.jpg\" data-sub-html=\"Credit: CC0 Public Domain\">\n<figure class=\"article-img\">\n            <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2019\/internetofth.jpg\" alt=\"internet of things\" title=\"Credit: CC0 Public Domain\" width=\"800\" height=\"511\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Credit: CC0 Public Domain<br \/>\n            <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n<p>The Berlin Institute for the Foundations of Learning and Data (BIFOLD) announces the open-source release of NebulaStream, a next-generation stream processing engine built for the unique challenges faced in IoT environments.<\/p>\n<p>A paper titled &#8220;NebulaStream: An Extensible, High-Performance Streaming Engine for Multi-Modal Edge <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">App<\/a>lications,&#8221; has been <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3722212.3725118\" target=\"_blank\">published<\/a> in the journal <i>Companion of the 2025 International Conference on Management of Data<\/i>.<\/p>\n<p>The software is freely available under an Apache 2.0 license. Furthermore, the NEEDMI Project, which leverages NebulaStream to implement a smart co-pilot for an intensive care unit (ICU), recently won the SIGMOD 2025 Best Demo Honorable Mention award. The demo showcases NebulaStream&#8217;s ability to integrate and process multi-modal, multi-frequency data streams, to improve the health assessment of patients in a smart ICU.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Built_for_the_edge\"><\/span>Built for the edge<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>NebulaStream was designed to process data directly where it is generated\u2014at the sensor, edge device, or gateway. The system supports diverse hardware architectures (ARM, x86) and compiles user queries into hardware-tailored code.<\/p>\n<p>Adaptive resource management ensures robust performance, even under changing conditions or without Internet connectivity. Target applications include predictive maintenance, environmental monitoring, smart manufacturing, or smart medicine applications.<\/p>\n<figure class=\"mb-4\" itemscope=\"\" itemtype=\"http:\/\/schema.org\/VideoObject\">\n    <meta itemprop=\"name\" content=\"High-performance data management for the Internet of Things\"\/><br \/>\n    <meta itemprop=\"url\" content=\"https:\/\/www.youtube.com\/watch\/?v=Yt00270NkP0\"\/><br \/>\n    <meta itemprop=\"description\" content=\"High-performance data management for the Internet of Things\"\/><br \/>\n    <meta itemprop=\"uploadDate\" content=\"2025-07-04T04:48:06-04:00\"\/><br \/>\n        <meta itemprop=\"embedUrl\" content=\"https:\/\/www.youtube.com\/embed\/Yt00270NkP0\"\/><br \/>\n    <meta itemprop=\"thumbnailUrl\" content=\"https:\/\/img.youtube.com\/vi\/Yt00270NkP0\/maxresdefault.jpg\"\/><\/p>\n<p>\n             <iframe loading=\"lazy\" title=\"Showcasing Data Management Challenges for Future IoT Applications with NebulaStream (VLDB-2023)\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/Yt00270NkP0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n         <\/p>\n<\/figure>\n<p>                                                                                                        <!-- TechX - News - In-article --><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Flexible_extensible_ready_for_production\"><\/span>Flexible, extensible, ready for production<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>NebulaStream comes with out-of-the-box support for common stream tasks, such as data alignment and inference. Developers can easily add custom operators, formats, and optimizations, making the system highly adaptable to specialized requirements\u2014without having to deal with low-level internals.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Demos\"><\/span>Demos<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>NebulaStream powers innovative applications across diverse domains. The IoTropolis project demo simulates a smart city to demonstrate how NebulaStream addresses data management challenges in IoT, eHealth, and Smart Grid scenarios.<\/p>\n<p>In the health care sector, a NEEDMI project demo was developed to showcase how NebulaStream can be employed to support medical staff in intensive care units by enabling real-time data processing at a patient&#8217;s bedside.<\/p>\n<figure class=\"mb-4\" itemscope=\"\" itemtype=\"http:\/\/schema.org\/VideoObject\">\n    <meta itemprop=\"name\" content=\"High-performance data management for the Internet of Things\"\/><br \/>\n    <meta itemprop=\"url\" content=\"https:\/\/www.youtube.com\/watch\/?v=7tH6zkCdMG8\"\/><br \/>\n    <meta itemprop=\"description\" content=\"High-performance data management for the Internet of Things\"\/><br \/>\n    <meta itemprop=\"uploadDate\" content=\"2025-07-04T04:48:54-04:00\"\/><br \/>\n        <meta itemprop=\"embedUrl\" content=\"https:\/\/www.youtube.com\/embed\/7tH6zkCdMG8\"\/><br \/>\n    <meta itemprop=\"thumbnailUrl\" content=\"https:\/\/img.youtube.com\/vi\/7tH6zkCdMG8\/maxresdefault.jpg\"\/><\/p>\n<p>\n             <iframe loading=\"lazy\" title=\"NEEDMI: Advancing the ICU with Nebula Stream - At a Glance\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/7tH6zkCdMG8?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n         <\/p>\n<\/figure>\n<h2><span class=\"ez-toc-section\" id=\"From_research_to_real-world_impact\"><\/span>From research to real-world impact<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>NebulaStream was developed as part of a collaborative research initiative led by BIFOLD, the DIMA Group at TU Berlin, and the IAM Group at DFKI. First presented in a scientific preprint in 2020, the system has now been released as open-source in the SIGMOD 2025 conference.<\/p>\n<p>&#8220;We want to thank all contributors that made this possible, with their huge efforts over the last few years. Let us celebrate this together,&#8221; says Steffen Zeuch, Project Lead and System Architect of NebulaStream.<\/p>\n<div class=\"article-main__more p-4\">\n<p><strong>More information:<\/strong><br \/>\n\t\t\t\t\t\t\t\t\t\t\t\tAdrian Michalke et al, NebulaStream: An Extensible, High-Performance Streaming Engine for Multi-Modal Edge Applications, <i>Companion of the 2025 International Conference on Management of Data<\/i> (2025). <a rel=\"nofollow\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1145\/3722212.3725118\" target=\"_blank\">DOI: 10.1145\/3722212.3725118<\/a>\n<\/p>\n<p>The source code, documentation, and contribution guidelines are available at: <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/nebula.stream\">https:\/\/nebula.stream<\/a><\/p>\n<\/p><\/div>\n<p>\n                                                Provided by<br \/>\n                                                                                                    Berlin Institute for the Foundations of Learning and Data \u2013 BIFOLD<\/p>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>\n                                                <strong>Citation<\/strong>:<br \/>\n                                                Open-source engine enables high-performance data processing for Internet of Things devices (2025, July 4)<br \/>\n                                                retrieved 6 July 2025<br \/>\n                                                from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2025-07-source-enables-high-internet-devices.html\n                                            <\/p>\n<p>\n                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.\n                                            <\/p>\n<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" target=\"_blank\" >Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2025-07-source-enables-high-internet-devices.html\" target=\"_blank\" >Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Credit: CC0 Public Domain The Berlin Institute for the Foundations of Learning and Data (BIFOLD) announces the open-source release of NebulaStream, a next-generation stream processing engine built for the unique challenges faced in IoT environments. A paper titled &#8220;NebulaStream: An Extensible, High-Performance Streaming Engine for Multi-Modal Edge Applications,&#8221; has been published in the journal Companion&#8230;<\/p>\n","protected":false},"author":1,"featured_media":678874,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2019\/internetofth.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-678873","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/678873","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=678873"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/678873\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/678874"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=678873"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=678873"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=678873"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}