{"id":483344,"date":"2022-08-10T23:58:08","date_gmt":"2022-08-10T20:58:08","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/synchronization-of-spiking-oscillators-helps-build-physical-reservoirs\/"},"modified":"2022-08-10T23:58:08","modified_gmt":"2022-08-10T20:58:08","slug":"synchronization-of-spiking-oscillators-helps-build-physical-reservoirs","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/synchronization-of-spiking-oscillators-helps-build-physical-reservoirs\/","title":{"rendered":"#Synchronization of spiking oscillators helps build physical reservoirs"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_90 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6aff6812a7135\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6aff6812a7135\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/synchronization-of-spiking-oscillators-helps-build-physical-reservoirs\/#%E2%80%9CSynchronization_of_spiking_oscillators_helps_build_physical_reservoirs%E2%80%9D\" >&#8220;Synchronization of spiking oscillators helps build physical reservoirs&#8221;<\/a><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"%E2%80%9CSynchronization_of_spiking_oscillators_helps_build_physical_reservoirs%E2%80%9D\"><\/span>&#8220;Synchronization of spiking oscillators helps build physical reservoirs&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2022\/finding-order-using-ch.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/finding-order-using-ch.jpg\" data-sub-html=\"a) Topology of the network and node circuit diagram, b) Waveforms of a single node operating in periodic (top-left) and chaotic regions (bottom-left) followed by waveforms of two coupled nodes that are unsynchronized (top-right) and synchronized (bottom-right). c) Average synchronization across the entire network under the control of the coupling strength and a parameter that influences the dynamics of the circuit. The regions where the network is unsynchronized (blue), incompletely synchronized (yellow) and completely synchronized (red) are shown. A broad region of incomplete synchronization, when the network is operating near the edge of chaos, can be observed. Furthermore, the synchronization matrix in the region of incomplete synchronization shows the emergence of preferential entrainment between some node pairs with respect to others. Credit: Jim Bartels\">\n<figure class=\"article-img\">\n            <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2022\/finding-order-using-ch.jpg\" alt=\"Finding order using chaos: Synchronization of spiking oscillators helps build physical reservoirs\" title=\"a) Topology of the network and node circuit diagram, b) Waveforms of a single node operating in periodic (top-left) and chaotic regions (bottom-left) followed by waveforms of two coupled nodes that are unsynchronized (top-right) and synchronized (bottom-right). c) Average synchronization across the entire network under the control of the coupling strength and a parameter that influences the dynamics of the circuit. The regions where the network is unsynchronized (blue), incompletely synchronized (yellow) and completely synchronized (red) are shown. A broad region of incomplete synchronization, when the network is operating near the edge of chaos, can be observed. Furthermore, the synchronization matrix in the region of incomplete synchronization shows the emergence of preferential entrainment between some node pairs with respect to others. Credit: Jim Bartels\" width=\"800\" height=\"530\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                a) Topology of the network and node circuit diagram, b) Waveforms of a single node operating in periodic (top-left) and chaotic regions (bottom-left) followed by waveforms of two coupled nodes that are unsynchronized (top-right) and synchronized (bottom-right). c) Average synchronization across the entire network under the control of the coupling strength and a parameter that influences the dynamics of the circuit. The regions where the network is unsynchronized (blue), incompletely synchronized (yellow) and completely synchronized (red) are shown. A broad region of incomplete synchronization, when the network is operating near the edge of chaos, can be observed. Furthermore, the synchronization matrix in the region of incomplete synchronization shows the emergence of preferential entrainment between some node pairs with respect to others. Credit: Jim Bartels<br \/>\n            <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n<p>Engineers at the Tokyo Institute of <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">Technology<\/a> (Tokyo Tech) have demonstrated a computational <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">app<\/a>roach using a ring network of coupled spiking oscillators with chaotic dynamics implemented on analog hardware. This new approach is based on the emergence and pattern formation phenomena that occur under &#8220;incomplete synchronization&#8221; within chaotic dynamics. In the future, it could significantly impact conventional methods for pattern detection commonly used in artificial neural networks on digital hardware counterparts.<\/p>\n<p>                                                                                In recent times, algorithms based on artificial intelligence (AI) are finding various societal applications such as personalized health care, autonomous driving, smart cities and precision farming. The amount of computing capability necessary to deploy such algorithms is increasing. Therefore, research initiatives are looking at alternative AI approaches taking inspiration from existing natural systems.<\/p>\n<p>One approach is physical reservoir computing, where an ensemble of dynamical elements exploiting physical phenomena is used to map input data onto a high-dimensional space. The merit of this method is the reduced need for training algorithms that require a large amount of processing power. These reservoirs can often be implemented by very simple physical systems and do not require complex architectures as is the case with neural networks. <\/p>\n<p>The circuit that was used in this study, named the Minati-Frasca circuit and initially discovered and developed by researchers at the Universities of Trento and Catania in Italy, is highly elementary, involving only five passive and two active components, while showing rich spiking behavior. &#8220;These circuits are truly remarkable and are a natural candidate for physical reservoir computing,&#8221; says Dr. Hiroyuki Ito, head of the Nano Sensing Unit where the study was conducted.<\/p>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2022\/finding-order-using-ch-1.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/finding-order-using-ch-1.jpg\" data-sub-html=\"a) Effect of coherent noise injected into the network, realized by means of an additional current source. The parameter map shows the difference in average synchronization between no noise and maximal induced noise. b) Splitting the network into two halves, one operating in chaos (A) and the other showing periodic behavior (B), by setting the control parameter differently. Non-monotonic effects are observed from the plot for the periodic half, revealing adversarial road-to-synchronization effects across nodes. c) Hypothetical configuration of the network of chaotic oscillators when used as a reservoir, receiving perturbations on the coupling strengths and the control parameter. Credit: Jim Bartels\">\n<figure class=\"article-img text-center\">\n            <img decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2022\/finding-order-using-ch-1.jpg\" alt=\"Finding order using chaos: Synchronization of spiking oscillators helps build physical reservoirs\"\/><figcaption class=\"text-left text-darken text-truncate text-low-up mt-3\">\n                a) Effect of coherent noise injected into the network, realized by means of an additional current source. The parameter map shows the difference in average synchronization between no noise and maximal induced noise. b) Splitting the network into two halves, one operating in chaos (A) and the other showing periodic behavior (B), by setting the control parameter differently. Non-monotonic effects are observed from the plot for the periodic half, revealing adversarial road-to-synchronization effects across nodes. c) Hypothetical configuration of the network of chaotic oscillators when used as a reservoir, receiving perturbations on the coupling strengths and the control parameter. Credit: Jim Bartels<br \/>\n            <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n<p>The experiments performed by the researchers at Tokyo Tech included tuning the chaoticity and coupling strength within a ring network of Minati-Frasca circuits. Initially, at low values of a suitable control parameter, the network showed periodic spiking, followed by highly irregular behavior when this parameter was increased. In combination with sweeping the coupling strength, this operation revealed a rich variety of ways in which the network synchronizes, meaning that nodes within it show similar behavior as can be observed in their waveforms . Considering the network as a whole, the emergence of synchronization patterns with a preferential synchronization of some node pairs over others, a situation known as incomplete synchronization, can be observed within chaos. Furthermore, in the case of this particular network, this region reaches maximal width near the edge of chaos, which is the boundary between periodic and chaotic regions of operation.<br \/>\n                                            <!-- Google middle Adsense block --><\/p>\n<p>The researchers at Tokyo Tech then introduced two additional factors to influence the &#8220;route-to-synchronization,&#8221; namely, the injection of coherent noise into each node within the network and splitting of the network into two different populations. The former showed that the extra noise significantly reduces the synchronization of the network in the periodic region, while in the chaotic region, the area of incomplete synchronization shifts and the synchronization of nodes that are not structurally adjacent is enhanced. This indicates that the network can respond to external stimuli in a complex manner. The latter experiment split the network into two halves, one operating within chaos and the other within periodicity.<\/p>\n<p>The route-to-synchronization under this condition was examined with a coupling strength sweep, producing a striking diversification of the synchronization behaviors between the two populations. While the synchronization strength steadily increased within the chaotic half, the periodic half showed non-monotonic effects, i.e., multiple minima appeared when sweeping the coupling strength. In addition, upon investigating the synchronization patterns in detail, an adversarial behavior was revealed, showing an initial synchronization of the periodic half which was then overtaken by the chaotic half, followed by a final overall synchronization between both halves. This effect further underlines the generative potential of this network. In essence, a binary split of two populations shows a highly simplified scenario of the input perturbations that this network could be exposed to when used for physical reservoir computing.<\/p>\n<p>As such, the researchers considered the network in their study and proposed to use it for implementing reservoir computing in the future by exploiting the various phenomena that were described above. &#8220;Coming from a background of machine learning, the couplings within the network reminded me of working with neural networks. However, at first I was not able to understand the implications of changing dynamics and chaos, since conventional AI algorithms tend not to have their innate dynamical activity,&#8221; says Jim Bartels, one of the lead authors of this study. &#8220;I realized that exploiting these dynamics for computation could fit well into the field of reservoir computing, which remains a growing area of study.&#8221;<\/p>\n<p>After this interview, the team explained why this type of reservoir computing could be beneficial for applications in society. &#8220;One of the main fields of research that we are working on in the Nano Sensing Unit is time <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/watch-movies-tv-seriess\/\" data-internallinksmanager029f6b8e52c=\"8\" title=\"Watch Movies &amp; TV Series\" target=\"_blank\" rel=\"noopener\">series<\/a> classification for internet-of-things (IoT) devices and edge computing, such as animal behavior classification. A very important consideration for these devices is their battery lifetime, since it determines the barrier towards concrete adoption. What is exciting about physical reservoirs such as the one we have proposed is the possibility of operating, in future integrated realizations yet to be built, at a lower power than large digital neural networks. As the circuit represents one of the smallest known types of spike-generating oscillators, going beyond the present proof-of-concept stage, we expect researchers worldwide to explore its many possible variations for additional computational frameworks, such as neural networks,&#8221; they commented.<\/p>\n<p>Ludovico Minati, who is the leading author of the study. The experiments that were undertaken, the design of the hardware, the results and their discussion are reported in a recent article published in the journal <i>Chaos, Solitons &amp; Fractals<\/i>. Furthermore, all design materials and experimental data have been made freely downloadable.\n                                                                                                                        <\/p>\n<hr\/>\n<div class=\"article-main__explore my-4 d-print-none\">\n<p>                                            Exploring partial synchronization in networked systems\n                                        <\/p><\/div>\n<hr class=\"mb-4\"\/>\n<div class=\"article-main__more p-4\">\n                                                                                                <strong>More information:<\/strong><br \/>\n                                                Ludovico Minati et al, Synchronization phenomena in dual-transistor spiking oscillators realized experimentally towards physical reservoirs, <i>Chaos, Solitons &amp; Fractals<\/i> (2022).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1016\/j.chaos.2022.112415\">DOI: 10.1016\/j.chaos.2022.112415<\/a><br \/>\nJulien Clinton Sprott et al, Elegant Circuits, <i>World Scientific 2022<\/i> (2021).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1142\/12362\">DOI: 10.1142\/12362<\/a><\/p>\n<p>Jim Bartels et al, TinyCowNet: Memory- and Power-Minimized RNNs Implementable on Tiny Edge Devices for Lifelong Cow Behavior Distribution Estimation, <i>IEEE Access<\/i> (2022).  <a rel=\"nofollow noopener\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1109\/ACCESS.2022.3156278\">DOI: 10.1109\/ACCESS.2022.3156278<\/a><\/p>\n<\/div>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    Tokyo Institute of Technology<br \/>\n                                                                                                        <a rel=\"nofollow noopener\" target=\"_blank\" class=\"icon_open\" href=\"http:\/\/www.titech.ac.jp\/\"><br \/>\n                                                        <svg>\n                                                            <use href=\"https:\/\/techx.b-cdn.net\/tmpl\/v2\/img\/svg\/sprite.svg#icon_open\" x=\"0\" y=\"0\"\/>\n                                                        <\/svg><br \/>\n                                                    <\/a><\/p><\/div>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>\n                                                 <strong>Citation<\/strong>:<br \/>\n                                                 Finding order using chaos: Synchronization of spiking oscillators helps build physical reservoirs (2022, August 10)<br \/>\n                                                 retrieved 11 August 2022<br \/>\n                                                 from https:\/\/techxplore.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2022-08-chaos-synchronization-spiking-oscillators-physical.html<\/p>\n<p>                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMLG0nwswvr63Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\">For forums sites go to <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/forum.buradabiliyorum.com\/\" target=\"_blank\" rel=\"noopener\">Forum.BuradaBiliyorum.Com<\/a><\/span><\/strong>\n<\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/en.buradabiliyorum.com\/science\/\" target=\"_blank\" rel=\"noopener\">Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/techxplore.com\/news\/2022-08-chaos-synchronization-spiking-oscillators-physical.html\" target=\"_blank\" rel=\"noopener\">Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Synchronization of spiking oscillators helps build physical reservoirs&#8221; a) Topology of the network and node circuit diagram, b) Waveforms of a single node operating in periodic (top-left) and chaotic regions (bottom-left) followed by waveforms of two coupled nodes that are unsynchronized (top-right) and synchronized (bottom-right). c) Average synchronization across the entire network under the control&#8230;<\/p>\n","protected":false},"author":1,"featured_media":483345,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2022\/finding-order-using-ch.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-483344","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/483344","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=483344"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/483344\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/483345"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=483344"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=483344"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=483344"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}