{"id":664928,"date":"2026-06-29T20:35:17","date_gmt":"2026-06-29T20:35:17","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/664928\/"},"modified":"2026-06-29T20:35:17","modified_gmt":"2026-06-29T20:35:17","slug":"from-brain-waves-to-words-brain2qwerty-offers-a-new-path-to-communication-without-surgery","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/664928\/","title":{"rendered":"From Brain Waves to Words: Brain2Qwerty Offers a New Path to Communication Without Surgery"},"content":{"rendered":"<p class=\"_a92o _a5c- _a5w7\">Last year, we introduced <a href=\"https:\/\/ai.meta.com\/blog\/brain-ai-research-human-communication\/\" target=\"_blank\" rel=\"nofollow noopener\">Brain2Qwerty<\/a> v1, research that uses AI to decode brain activity into text without any surgical implant. Now we&#8217;re sharing the next step: Brain2Qwerty v2, the highest-performing end-to-end pipeline capable of real-time sentence decoding from non-invasive brain recordings, approaching levels of accuracy previously exclusive to techniques that require brain surgery.<\/p>\n<p class=\"_a92o _a5c- _a5w7\">To help accelerate neuroscience breakthroughs, we&#8217;re releasing the full training code for Brain2Qwerty v1 and v2, and our partner, the Basque Center on Cognition, Brain, and Language (BCBL), is releasing the <a href=\"https:\/\/huggingface.co\/datasets\/bcbl190626\/SpanishBCBL\" target=\"_blank\" rel=\"noreferrer nofollow noopener\">v1 dataset<\/a>. We believe this research has the potential to make a real difference for the <a href=\"https:\/\/thejns.org\/view\/journals\/j-neurosurg\/130\/4\/article-p1080.xml\" target=\"_blank\" rel=\"noreferrer nofollow noopener\">millions of people<\/a> who suffer from brain lesions that prevent them from communicating. Invasive procedures like stereotactic electroencephalography and electrocorticography have shown that a neuroprosthesis feeding signals to an AI decoder can restore communication, but they&#8217;re difficult to scale. Our noninvasive approach can help bridge that gap.<\/p>\n<p><img decoding=\"async\" class=\"_8h4h img\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/06\/731199808_1542868887492186_7676795253949750980_n.png\" alt=\"\" id=\"u_0_6_B1\" style=\"box-sizing:border-box;border-top-left-radius:px;border-top-right-radius:px;border-bottom-left-radius:px;border-bottom-right-radius:px;\"\/><\/p>\n<p class=\"_a92o _a5c- _a5w7\">We trained Brain2Qwerty v2 on approximately 22,000 sentences from nine volunteer participants, each recorded for 10 hours wearing a magnetoencephalography (MEG) device while actively typing. Instead of relying on hand-crafted pipelines to detect neural events, we use end-to-end deep learning to decode directly from raw brain signals.<\/p>\n<p><img decoding=\"async\" class=\"_as9p _1-qs _9mk0 img\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/06\/731219869_1076086811651166_7777400260549956173_n.png\" alt=\"\" id=\"u_0_7_hc\" style=\"border-top-left-radius:px;border-top-right-radius:px;border-bottom-left-radius:px;border-bottom-right-radius:px;\"\/><\/p>\n<p class=\"_a92o _a5c- _a5w7\">Fine-tuning large language models on neural data allows the system to leverage semantic context, bridging the gap between noisy brain recordings and coherent language. We also deployed AI agents to explore optimizations for the decoding pipeline, with final training configurations selected manually by engineers.<\/p>\n<p><img decoding=\"async\" class=\"_as9p _1-qs _9mk0 img\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/06\/731158975_1696243454915298_6767206741376253564_n.png\" alt=\"\" id=\"u_0_8_9K\" style=\"border-top-left-radius:px;border-top-right-radius:px;border-bottom-left-radius:px;border-bottom-right-radius:px;\"\/><\/p>\n<p class=\"_a92o _a5c- _a5w7\">The result: Brain2Qwerty v2 recovers sentences coherently from noisy neural inputs, achieving a word accuracy rate of 61%, significantly improving upon the 8% word accuracy from <a href=\"https:\/\/www.nature.com\/articles\/s41593-023-01304-9)\" target=\"_blank\" rel=\"noreferrer nofollow noopener\">other non-invasive methods<\/a>. And for our best participant, we achieve a 78% word accuracy, where more than half of all sentences are decoded with one word error or less.<\/p>\n<p class=\"_a92o _a5c- _a5w7\">We also find that decoding accuracy improves log-linearly with data volume, suggesting that the remaining performance gap with surgical approaches could be further narrowed through data scaling alone. This work contributes to our efforts to build open foundational models of the brain, with our <a href=\"https:\/\/ai.meta.com\/blog\/tribe-v2-brain-predictive-foundation-model\/\" target=\"_blank\" rel=\"nofollow noopener\">Tribev2 model<\/a> for perception encoding, <a href=\"https:\/\/arxiv.org\/html\/2605.03169v1\" target=\"_blank\" rel=\"noreferrer nofollow noopener\">NeuralSet<\/a> to process brain data at scale, and <a href=\"https:\/\/arxiv.org\/abs\/2605.08495\" target=\"_blank\" rel=\"noreferrer nofollow noopener\">NeuralBench<\/a> to systematically evaluate models. We do this in close collaboration with the community, through our recent $5 million fund to stimulate open datasets in our <a href=\"https:\/\/digitalbrainproject.org\/\" target=\"_blank\" rel=\"noreferrer nofollow noopener\">Digital Brain Project<\/a>. Our hope is that this work, done in the open, advances neuroscience to identify, diagnose, and treat neurological disorders faster than in siloes.<\/p>\n","protected":false},"excerpt":{"rendered":"Last year, we introduced Brain2Qwerty v1, research that uses AI to decode brain activity into text without any&hellip;\n","protected":false},"author":2,"featured_media":664929,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-664928","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/664928","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=664928"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/664928\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/664929"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=664928"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=664928"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=664928"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}