{"id":369587,"date":"2021-11-19T21:37:35","date_gmt":"2021-11-19T18:37:35","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/deepfaking-the-mind-could-improve-brain-computer-interfaces-for-people-with-disabilities\/"},"modified":"2021-11-19T21:37:35","modified_gmt":"2021-11-19T18:37:35","slug":"deepfaking-the-mind-could-improve-brain-computer-interfaces-for-people-with-disabilities","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/deepfaking-the-mind-could-improve-brain-computer-interfaces-for-people-with-disabilities\/","title":{"rendered":"#’Deepfaking the mind’ could improve brain-computer interfaces for people with disabilities"},"content":{"rendered":"

“#’Deepfaking the mind’ could improve brain-computer interfaces for people with disabilities<\/strong>”<\/p>\n

\n
\n
\n
\n \"brain\"
\n Credit: CC0 Public Domain
\n <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n

Researchers at the USC Viterbi School of Engineering are using generative adversarial networks (GANs)\u2014technology<\/a> best known for creating deepfake videos and photorealistic human faces\u2014to improve brain-computer interfaces for people with disabilities.\n <\/p>\n

In a paper published in Nature Biomedical Engineering<\/i>, the team successfully taught an AI to generate synthetic brain activity data. The data, specifically neural signals called spike trains, can be fed into machine-learning algorithms to improve the usability of brain-computer interfaces (BCI).<\/p>\n

BCI systems work by analyzing a person’s brain signals and translating that neural activity into commands, allowing the user to control digital devices like computer cursors using only their thoughts. These devices can improve quality of life for people with motor dysfunction or paralysis, even those struggling with locked-in syndrome\u2014when a person is fully conscious but unable to move or communicate.<\/p>\n

Various forms of BCI are already available, from caps that measure brain signals to devices implanted in brain tissues. New use cases are being identified all the time, from neurorehabilitation to treating depression. But despite all of this promise, it has proved challenging to make these systems fast and robust enough for the real world.<\/p>\n

Specifically, to make sense of their inputs, BCIs need huge amounts of neural data and long periods of training, calibration and learning.<\/p>\n

“Getting enough data for the algorithms that power BCIs can be difficult, expensive, or even impossible if paralyzed individuals are not able to produce sufficiently robust brain signals,” said Laurent Itti, a computer science<\/a> professor and study co-author.<\/p>\n

Another obstacle: the technology is user-specific and has to be trained from scratch for each person.<\/p>\n

Generating synthetic neurological data<\/b><\/p>\n

What if, instead, you could create synthetic neurological data\u2014artificially computer-generated data\u2014that could “stand in” for data obtained from the real world?
\n <\/p>\n

Enter generative adversarial networks. Known for creating “deep fakes,” GANs can create a virtually unlimited number of new, similar images by running through a trial-and-error process.<\/p>\n

Lead author Shixian Wen, a Ph.D. student advised by Itti, wondered if GANs could also create training data for BCIs by generating synthetic neurological data indistinguishable from the real thing.<\/p>\n

In an experiment described in the paper, the researchers trained a deep-learning spike synthesizer with one session of data recorded from a monkey reaching for an object. Then, they used the synthesizer to generate large amounts of similar\u2014albeit fake\u2014neural data.<\/p>\n

The team then combined the synthesized data with small amounts of new real data\u2014either from the same monkey on a different day, or from a different monkey\u2014to train a BCI. This app<\/a>roach got the system up and running much faster than current standard methods. In fact, the researchers found that GAN-synthesized neural data improved a BCI’s overall training speed by up to 20 times.<\/p>\n

“Less than a minute’s worth of real data combined with the synthetic data works as well as 20 minutes of real data,” said Wen.<\/p>\n

“It is the first time we’ve seen AI generate the recipe for thought or movement via the creation of synthetic spike trains. This research is a critical step towards making BCIs more suitable for real-world use.”<\/p>\n

Additionally, after training on one experimental session, the system rapidly adapted to new sessions, or subjects, using limited additional neural data.<\/p>\n

“That’s the big innovation here\u2014creating fake spike trains that look just like they come from this person as they imagine doing different motions, then also using this data to assist with learning on the next person,” said Itti.<\/p>\n

Beyond BCIs, GAN-generated synthetic data could lead to breakthroughs in other data-hungry areas of artificial intelligence by speeding up training and improving performance.<\/p>\n

“When a company is ready to start commercializing a robotic skeleton, robotic arm or speech synthesis system, they should look at this method, because it might help them with accelerating the training and retraining,” said Itti. “As for using GAN to improve brain-computer interfaces, I think this is only the beginning.”\n <\/p>\n\n

\n

Machine learning, meet human emotions: How to help a computer monitor your mental state<\/a>\n <\/div>\n

\n
\n More information:<\/strong>
\n Shixian Wen et al, Rapid adaptation of brain\u2013computer interfaces to new neuronal ensembles or participants via generative modelling, Nature Biomedical Engineering<\/i> (2021). DOI: 10.1038\/s41551-021-00811-z<\/a><\/p><\/div>\n
\n Provided by
\n University of Southern California
\n
\n \n \n <\/svg>
\n <\/a><\/p><\/div>\n

<\/p>\n

\n

\n Citation<\/strong>:
\n ‘Deepfaking the mind’ could improve brain-computer interfaces for people with disabilities (2021, November 19)
\n retrieved 19 November 2021
\n from https:\/\/medicalxpress.com\/news<\/a>\/2021-11-deepfaking-mind-brain-computer-interfaces-people.html<\/p>\n

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
\n part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n