{"id":698220,"date":"2025-11-08T16:05:11","date_gmt":"2025-11-08T13:05:11","guid":{"rendered":"https:\/\/buradabiliyorum.com\/en\/mind-captioning-technique-can-read-human-thoughts-from-brain-scans\/"},"modified":"2025-11-08T16:05:11","modified_gmt":"2025-11-08T13:05:11","slug":"mind-captioning-technique-can-read-human-thoughts-from-brain-scans","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/mind-captioning-technique-can-read-human-thoughts-from-brain-scans\/","title":{"rendered":"&#8216;Mind-captioning&#8217; technique can read human thoughts from brain scans"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_89 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6aec0bfd7579d\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd3333;color:#dd3333\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd3333;color:#dd3333\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6aec0bfd7579d\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/buradabiliyorum.com\/en\/mind-captioning-technique-can-read-human-thoughts-from-brain-scans\/#Generating_video_captions_from_human_perception\" >Generating video captions from human perception<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/buradabiliyorum.com\/en\/mind-captioning-technique-can-read-human-thoughts-from-brain-scans\/#Reading_memories\" >Reading memories<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/buradabiliyorum.com\/en\/mind-captioning-technique-can-read-human-thoughts-from-brain-scans\/#Ethical_considerations_and_future_directions\" >Ethical considerations and future directions<\/a><\/li><\/ul><\/nav><\/div>\n<div>\n<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2025\/researchers-use-mind-c.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2025\/researchers-use-mind-c.jpg\" data-sub-html=\"Mind captioning. Credit: &lt;i&gt;Science Advances&lt;\/i&gt; (2025). DOI: 10.1126\/sciadv.adw1464\">\n<figure class=\"article-img\">\n            <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/scx1.b-cdn.net\/csz\/news\/800a\/2025\/researchers-use-mind-c.jpg\" alt=\"Researchers use 'mind-captioning' technique to read human thoughts from brain scans\" title=\"Mind captioning. Credit: Science Advances (2025). DOI: 10.1126\/sciadv.adw1464\" width=\"800\" height=\"307\"\/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Mind captioning. Credit: <i><a href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" data-internallinksmanager029f6b8e52c=\"5\" title=\"Science\" target=\"_blank\" rel=\"noopener\">Science<\/a> Advances<\/i> (2025). DOI: 10.1126\/sciadv.adw1464<br \/>\n            <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n<p>Reading brain activity with advanced technologies is not a new concept. However, most techniques have focused on identifying single words associated with an object or action a person is seeing or thinking of, or matching up brain signals that correspond to spoken words. Some methods used caption databases or deep neural networks, but these approaches were limited by database word coverage or introduced information not present in the brain. Generating detailed, structured de<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/download-scripts-themes-apps\/\" data-internallinksmanager029f6b8e52c=\"9\" title=\"Download Scripts &amp; Themes &amp; Apps\" target=\"_blank\" rel=\"noopener\">script<\/a>ions of complex visual perceptions or thoughts remains difficult.<\/p>\n<p>A study, recently <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/www.science.org\/doi\/10.1126\/sciadv.adw1464\" target=\"_blank\">published<\/a> in <i>Science Advances<\/i>, takes a new approach. Researchers involved in the study have developed what they refer to as a &#8220;mind-captioning&#8221; technique that uses an iterative optimization process, where a masked language model (MLM) generates text descriptions by aligning text features with brain-decoded features.<\/p>\n<p>The technique also incorporates linear models trained to decode semantic features from a deep language model using brain activity from functional magnetic resonance imaging (fMRI). The result is a detailed text description of what a participant is seeing in their brain.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Generating_video_captions_from_human_perception\"><\/span>Generating video captions from human perception<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>For the first part of the experiment, six people watched 2,196 short videos while their brain activity was scanned with fMRI. The videos featured various random objects, scenes, actions, and events, and the six subjects were native Japanese speakers and non-native English speakers.<\/p>\n<p>The same videos previously underwent a kind of crowdsourced text captioning by other viewers, which was processed by a pretrained LM, called DeBERTa-large that extracted particular features. These features were matched to brain activity and text was generated through an iterative process by the MLM model, called RoBERTa-large.<\/p>\n<p>&#8220;Initially, the descriptions were fragmented and lacked clear meaning. However, through iterative optimization, these descriptions naturally evolved to have a coherent structure and effectively capture the key aspects of the viewed videos. Notably, the resultant descriptions accurately reflected the content, including the dynamic changes in the viewed events. Furthermore, even when specific objects were not correctly identified, the descriptions still successfully conveyed the presence of interactions among multiple objects,&#8221; the study authors explain.<\/p>\n<p>The team then compared the generated descriptions to both correct and incorrect captions across various numbers of candidates to determine accuracy, which they say was around 50%. They note that this level of accuracy surpasses other current approaches and holds promise for future improvement.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Reading_memories\"><\/span>Reading memories<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The same six participants were later asked to recall the videos under fMRI to test out the method&#8217;s ability to read memory, instead of visual experience. The results for this part of the experiment were also promising.<\/p>\n<p>&#8220;The analysis successfully generated descriptions that accurately reflected the content of the recalled videos, although accuracy varied among individuals. These descriptions were more similar to the captions of the recalled videos than to irrelevant ones, with proficient subjects achieving nearly 40% accuracy in identifying recalled videos from 100 candidates,&#8221; the study authors write.<\/p>\n<p>For people who have a diminished or lost capacity to speak, such as those who have had a stroke, this new <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/technology\/\" data-internallinksmanager029f6b8e52c=\"4\" title=\"Technology\" target=\"_blank\" rel=\"noopener\">technology<\/a> could eventually serve as a way to restore communication. The fact that the system has proven itself capable of picking up on deeper meanings and relationships, instead of simple word associations, could allow these individuals to regain much more of their communication ability than some of the other brain-computer interface methods. Still, further optimization is necessary before getting to that point.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Ethical_considerations_and_future_directions\"><\/span>Ethical considerations and future directions<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Regardless of some of the more positive applications for mind-captioning devices capable of reading human thought, there are certainly legitimate concerns regarding privacy and potential misuse of brain-to-text technology.<\/p>\n<p>The researchers involved in the study note that consent will remain a major ethical consideration when employing mind-reading techniques. Before more widespread use of these technologies is common, important questions about mental privacy and the future of brain-computer interfaces will need to be addressed.<\/p>\n<p>Still, the study offers up a new tool for scientific research into how the brain represents complex experiences and a potential boon for nonverbal individuals.<\/p>\n<p>The study authors write, &#8220;Together, our approach balances interpretability, <a href=\"https:\/\/buradabiliyorum.com\/en\/category\/general\/\" data-internallinksmanager029f6b8e52c=\"3\" title=\"General\" target=\"_blank\" rel=\"noopener\">general<\/a>izability, and performance\u2014establishing a transparent framework for decoding nonverbal thought into language and paving the way for systematic investigation of how structured semantics are encoded across the human brain.&#8221;<\/p>\n<div class=\"article-main__support\">\n<p>\n    Written for you by our author <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/sciencex.com\/help\/editorial-team\/#authors\" target=\"_blank\">Krystal Kasal<\/a>, edited by <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/sciencex.com\/help\/editorial-team\/\" target=\"_blank\">Lisa Lock<\/a>, and fact-checked and reviewed by <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/sciencex.com\/help\/editorial-team\/\" target=\"_blank\">Robert Egan<\/a>\u2014this article is the result of careful human work. We rely on readers like you to keep independent science journalism alive.<br \/>\n    If this reporting matters to you,<br \/>\n    please consider a <a rel=\"nofollow\" target=\"_blank\" href=\"https:\/\/sciencex.com\/donate\/?utm_source=story&amp;utm_medium=story&amp;utm_campaign=story\">donation<\/a> (especially monthly).<br \/>\n    You&#8217;ll get an <b>ad-free<\/b> account as a thank-you.\n    <\/p>\n<\/p><\/div>\n<div class=\"article-main__more p-4\">\n<p><strong>More information:<\/strong><br \/>\n                                                    Tomoyasu Horikawa, Mind captioning: Evolving descriptive text of mental content from human brain activity, <i>Science Advances<\/i> (2025). <a rel=\"nofollow\" target=\"_blank\" data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1126\/sciadv.adw1464\" target=\"_blank\">DOI: 10.1126\/sciadv.adw1464<\/a><\/p>\n<\/p><\/div>\n<p class=\"article-main__note mt-4\">\n                                                \u00a9 2025 Science X Network\n                                            <\/p>\n<p>                                        <!-- print only --><\/p>\n<div class=\"d-none d-print-block\">\n<p>\n                                                 <strong>Citation<\/strong>:<br \/>\n                                                 &#8216;Mind-captioning&#8217; technique can read human thoughts from brain scans (2025, November 8)<br \/>\n                                                 retrieved 8 November 2025<br \/>\n                                                 from https:\/\/medicalxpress.com\/<a href=\"https:\/\/buradabiliyorum.com\/en\/category\/news\/\" data-internallinksmanager029f6b8e52c=\"2\" title=\"News\" target=\"_blank\" rel=\"noopener\">news<\/a>\/2025-11-mind-captioning-technique-human-thoughts.html\n                                            <\/p>\n<p>\n                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.\n                                            <\/p>\n<\/p><\/div>\n<\/p><\/div>\n<p><script id=\"facebook-jssdk\" async=\"\" src=\"https:\/\/connect.facebook.net\/en_US\/sdk.js\"><\/script><\/p>\n<blockquote><p><strong><span style=\"color: #ff6600;\">If you liked the article, do not forget to share it with your friends. Follow us on\u00a0<span style=\"color: #ff0000;\"><a style=\"color: #ff0000;\" href=\"https:\/\/news.google.com\/publications\/CAAqBwgKMN63nwsw68G3Aw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Google News<\/a><\/span>\u00a0too, click on the star and choose us from your favorites.<\/span><\/strong><\/p><\/blockquote>\n<blockquote>\n<p style=\"text-align: center;\"><strong>If you want to read more Like this articles, you can visit our <span style=\"color: #ff9900;\"><a style=\"color: #ff9900;\" href=\"https:\/\/buradabiliyorum.com\/en\/category\/sciencee\/\" target=\"_blank\" >Science category.<\/a><\/span><\/strong><\/p>\n<\/blockquote>\n<p><span style=\"color: black;\"><a style=\"color: #ff9900;\" href=\"https:\/\/medicalxpress.com\/news\/2025-11-mind-captioning-technique-human-thoughts.html\" target=\"_blank\" >Source<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Mind captioning. Credit: Science Advances (2025). DOI: 10.1126\/sciadv.adw1464 Reading brain activity with advanced technologies is not a new concept. However, most techniques have focused on identifying single words associated with an object or action a person is seeing or thinking of, or matching up brain signals that correspond to spoken words. Some methods used caption&#8230;<\/p>\n","protected":false},"author":1,"featured_media":698221,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/scx2.b-cdn.net\/gfx\/news\/hires\/2025\/researchers-use-mind-c.jpg","fifu_image_alt":"","footnotes":""},"categories":[16],"tags":[],"class_list":["post-698220","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-sciencee"],"_links":{"self":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/698220","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/comments?post=698220"}],"version-history":[{"count":0,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/posts\/698220\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media\/698221"}],"wp:attachment":[{"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/media?parent=698220"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/categories?post=698220"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/buradabiliyorum.com\/en\/wp-json\/wp\/v2\/tags?post=698220"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}