offbeat<\/p>\n
61% word accuracy is progress, but the system still relies on users typing and can’t yet support real-time communication. Implanted BCIs remain well ahead<\/p>\n
For those who can’t move their fingers to type, a brain-computer interface that can help them communicate by decoding neural activity is a lifeline. Researchers at Meta have been working on a noninvasive – no surgery required – brain-computer interface that is better than its predecessors, but still far from practically usable after more than a year of work.\u00a0<\/p>\n
Meta announced<\/a> the second iteration of its system designed to pick up and decode brain signals that fire when users are typing, called Brain2Qwerty, on Monday. The researchers explained in a pair<\/a> of papers<\/a> released alongside the announcement that B2Q v2 was able to achieve an average word accuracy of 61 percent (78 percent for the best-performing participant), which they said was a considerable improvement over previous noninvasive BCI systems that typically achieved only single-digit word accuracy.<\/p>\n B2Q v2 was trained on some 22,000 sentences typed by nine participants over the course of 10 hours, each of whom was outfitted with a magnetoencephalography (MEG) headset while typing. Meta then routed their brain signals through end-to-end deep learning algorithms and large language models trained to separate brain signals from brain noise.\u00a0<\/p>\n Non-surgical BCIs typically suffer from limited signal-to-noise ratios that make decoding difficult, and B2Q tested both MEG and electroencephalography (EEG) signals. EEG is more common in noninvasive BCI experiments, but Meta found MEG was far more effective at correctly decoding typed sentences due to its higher signal-to-noise ratio.\u00a0<\/p>\n \u201cA central objective of this study was to quantify the impact of the recording modality on decoding performance,\u201d the team wrote in one of their papers on the experiment. \u201cWhile we expected MEG to surpass EEG, the magnitude of the observed difference was substantial.\u201d<\/p>\n According to the team’s research paper published in Nature Neuroscience on Monday, the Brain2Qwerty system achieved an average character error rate of 29 percent using MEG, whereas EEG recordings produced an average character error rate of 65 percent.<\/p>\n The large language models that were trained to decode the MEG data into comprehensible sentences that (ideally) mimicked the ones the participants typed were the final part of the equation, Meta\u2019s researchers explained.\u00a0<\/p>\n \u201cFine-tuning large language models on neural data allows the system to leverage semantic context, bridging the gap between noisy brain recordings and coherent language,\u201d Meta said in its B2Q v2 announcement. \u201cWe also deployed AI agents to explore optimizations for the decoding pipeline, with final training configurations selected manually by engineers.\u201d<\/p>\n That\u2019s definitely an upgrade in performance, but it\u2019s not exactly a promising, commercially viable pathway when recent surgical BCI systems are reaching 92 percent sentence-level accuracy<\/a> in other experiments.\u00a0<\/p>\n Meta researchers argue the system’s performance should continue improving as more training data becomes available, despite it still correctly decoding only around 61 percent of words on average. According to the team, B2Q v2\u2019s accuracy \u201cimproves log-linearly with data volume,\u201d which should mean that shoveling more data into the AI models behind B2Q v2 would continually narrow the gap.\u00a0<\/p>\n More data won\u2019t fix the fact that training AI models to pick out typed words from brain activity is a bit useless when the target market doesn\u2019t have the ability to type, which the Meta minds admit in the conclusion of their paper.\u00a0<\/p>\n The current design may work for patients with limited mobility, they note, but locked-in individuals unable to use their bodies in any way are unlikely to benefit.\u00a0<\/p>\n \u201cBridging the gap to locked-in individuals will likely involve adapting our task into a motor imagery paradigm and designing AI systems capable of robust generalization across participants,\u201d the team explained.<\/p>\n Additionally, the current B2Q system remains confined to the lab because it still isn’t practical for real-time communication. Per the researchers, the transformer and language model B2Q uses require a trial to conclude before they can produce output, meaning there\u2019s no feedback from B2Q until a participant is done being prompted with sentences and has typed them all out.\u00a0\u00a0<\/p>\n Then there’s the fact that B2Q “currently requires MEG segments to be aligned to specific keystroke onsets,” which means the system still needs to know when users are pressing keys on a keyboard. Meta isn’t sure it can get around that either, with the researchers noting that “the path toward achieving continuous decoding without these explicit triggers remains uncertain.”<\/p>\n In other words, what we have here is a neat experiment with some impressive improvements over prior noninvasive BCIs, but nothing that\u2019s going to transform the landscape anytime soon. If Zuck is thinking he has another possible pivot to medical tech in the form of B2Q, he\u2019s just as likely to beat the competition as he was when he decided to go all-in on the metaverse<\/a> and crypto<\/a>. \u00ae<\/p>\n","protected":false},"excerpt":{"rendered":"offbeat 61% word accuracy is progress, but the system still relies on users typing and can’t yet support…\n","protected":false},"author":2,"featured_media":667771,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-667770","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/667770","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=667770"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/667770\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/667771"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=667770"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=667770"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=667770"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}