{"id":1252,"date":"2023-12-03T13:49:18","date_gmt":"2023-12-03T18:49:18","guid":{"rendered":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/?p=1252"},"modified":"2023-12-03T13:56:10","modified_gmt":"2023-12-03T18:56:10","slug":"telepathic-technology-novel-brain-implants-help-paralyzed-patients-communicate-again","status":"publish","type":"post","link":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/csci-tech\/telepathic-technology-novel-brain-implants-help-paralyzed-patients-communicate-again\/","title":{"rendered":"Telepathic Technology: Novel Brain Implants Help Paralyzed Patients Communicate Again"},"content":{"rendered":"

Whether through lively classroom discussions, profound conversations with friends, or political debates at family dinners, speech resides at the crux of human connection. Tragic, life-altering events, such as stroke, traumatic brain injury, and the development of neurodegenerative diseases such as ALS can contribute to a loss of speech, often via vocal paralysis. When the nervous system is ravaged by disease or injury, severe paralysis and consequent locked-in syndrome can occur. In cases of locked-in syndrome, a patient loses all motor abilities and can only communicate via blinking or very minimal movements, rendering traditional speech aids such as typing and writing tools useless. While years of research have produced<\/span>\u00a0several assistive speech devices targeted at patients with severe paralysis, these devices are often extremely limited in their vocabulary range and only offer output options that are choppy, slow, and inauthentic. Despite allowing patients to communicate to some degree, the shortcomings of these devices remove much of the character and connection a person derives through speech, leaving patients feeling socially and emotionally isolated (Ramsey and Crone, 2023).<\/span><\/p>\n

A recent study published in <\/span>Nature<\/span><\/i> has partially succeeded in remedying this issue. Through the development and use of brain-computer interfaces (BCIs), scientists have created a pathway that translates a patient\u2019s neural signal<\/span>s into personalized text, speech audio, and animated, expressive facial avatars. In a case study involving a 47 year-old woman suffering from severe paralysis and complete loss of speech as a result of a brainstem stroke sustained 18 years earlier, researchers Metzger et al. designed and implanted a BCI into the left hemisphere of the patient\u2019s brain, centered on her central sulcus and spanning the regions of her brain associated with speech production and language perception. The first of its kind, this BCI harnesses electrocorticography (ECoG) to decode neural signals for attempted speech and vocal tract movements into corresponding words, phrases, and facial expressions. Similar to the more familiar and established electroencephalography (EEG), which uses small electrodes attached to the scalp to monitor electrophysiological activity in the brain, electrocorticography can directly adhere to exposed surfaces of the brain to decode electric signals (\u201cElectrocorticography\u201d). The specific BCI used in this study contains a high-density array of 2<\/span>53 individual ECoG electrodes, connected to a percutaneous pedestal connector, which allows for the signals to be decoded and displayed on a computer interface (Metzger et al., 2023).<\/span><\/p>\n

Following surgical implantation, the BCI and its connector were hooked up to a computer, which contained deep learning models that had already been \u201ctrained\u201d via probability data to have predictive abilities that enable them to decode certain phones, silences, and articulatory gestures into words and phrases. An additional probability-based feature called a connectionist temporal classification loss function was added to the neural decoding network to distinguish the timing of the attempted speech and signals, which allowed for order and pauses between words to be identified. After being processed through this system, the decoded signals could either be translated directly into letters, discrete vocal speech units, or discrete articulatory gestures, which respectively produce artificial te<\/span>xt, speech, and facial expressions (Fig. 1, Metzger et al., 2023).\u00a0<\/span><\/p>\n

 <\/p>\n

\"\"
Figure 1.<\/strong> Overview of multimodal speech decoding in a patient with vocal paralysis. a.<\/strong> Overview of the speech-decoding pathway, from neural signal to speech output. b.<\/strong> Magnetic resonance imaging scan (MRI) of the patient\u2019s brain, showing stroke-induced atrophy in the brainstem resulting in severe paralysis. c.<\/strong> MRI of the patient\u2019s brain, overlaid with the implanted BCI in its actual location. d.<\/strong> Examples of simple articulatory movements attempted by the patient, coupled with their corresponding electrode-activation maps. Bottom graphs depict evoked cortical activity for each type of movement, along with the mean\u2009\u00b1\u2009standard error across trials.<\/figcaption><\/figure>\n

 <\/p>\n

This novel neuroprosthesis provides an unprecedented sense of personalization and authenticity to communication for patients with ex<\/span>treme paralysis. While previous assistive speech technology could at best reach a rate of 14 words per minute, the BCI used in the case study averages 78 words per minute, which is much closer to the average adult rate of speaking, roughly 150 words per minute. Additionally, the speech function can be personalized to the patient\u2019s voice prior to their vocal paralysis, and the facial expressions can be projected onto an avatar resembling the patient, adding another layer of personalization (Metzger et al., 2023).<\/span><\/p>\n

Innovations in speech-targeted neuroprosthetic technology have the potential to change the lives of thousands of people dealing with severe paralysis. Naturally, these solutions are not perfect\u2013 the error rate of this particular BCI is approximately 20% for direct text decoding, and 50% for direct speech decoding (Ramsey and Crone, 2023). Despite sounding high, these numbers are a remarkable improvement from more established technologies and point to the vast potential of BCIs a few years down the road. Additionally, while this case is still in its early stages, there are several other similar BCIs being developed for the same purpose (Willett et al., 2023).\u00a0 As research continues, it will be fascinating to observe the continued effects of this revolutionary technology on patients\u2019 lives.<\/span><\/p>\n

 <\/p>\n

References<\/strong><\/p>\n

Electrocorticography\u2014An overview | sciencedirect topics<\/span><\/i>. (n.d.). Retrieved November 4, 2023, from https:\/\/www.sciencedirect.com\/topics\/neuroscience\/electrocorticography<\/span><\/p>\n

Metzger, S. L., Littlejohn, K. T., Silva, A. B., Moses, D. A., Seaton, M. P., Wang, R., Dougherty, M. E., Liu, J. R., Wu, P., Berger, M. A., Zhuravleva, I., Tu-Chan, A., Ganguly, K., Anumanchipalli, G. K., & Chang, E. F. (2023). A high-performance neuroprosthesis for speech decoding and avatar control. <\/span>Nature<\/span><\/i>, <\/span>620<\/span><\/i>(7976), 1037\u20131046. https:\/\/doi.org\/10.1038\/s41586-023-06443-4<\/span><\/p>\n

Ramsey, N. F., & Crone, N. E. (2023). Brain implants that enable speech pass performance milestones. <\/span>Nature<\/span><\/i>, <\/span>620<\/span><\/i>(7976), 954\u2013955. https:\/\/doi.org\/10.1038\/d41586-023-02546-0<\/span><\/p>\n

Willett, F. R., Kunz, E. M., Fan, C., Avansino, D. T., Wilson, G. H., Choi, E. Y., Kamdar, F., Glasser, M. F., Hochberg, L. R., Druckmann, S., Shenoy, K. V., & Henderson, J. M. (2023). A high-performance speech neuroprosthesis. <\/span>Nature<\/span><\/i>, <\/span>620<\/span><\/i>(7976), 1031\u20131036. https:\/\/doi.org\/10.1038\/s41586-023-06377-x<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Whether through lively classroom discussions, profound conversations with friends, or political debates at family dinners, speech resides at the crux of human connection. Tragic, life-altering events, such as stroke, traumatic brain injury, and the development of neurodegenerative diseases such as ALS can contribute to a loss of speech, often via vocal paralysis. When the nervous […]<\/p>\n","protected":false},"author":175,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[65,68],"tags":[],"class_list":{"0":"post-1252","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-csci-tech","7":"category-psych-neuro","8":"entry","9":"has-post-thumbnail"},"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":"Alexa Comess '26","author_link":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/author\/acomess\/"},"_links":{"self":[{"href":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/wp-json\/wp\/v2\/posts\/1252","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/wp-json\/wp\/v2\/users\/175"}],"replies":[{"embeddable":true,"href":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/wp-json\/wp\/v2\/comments?post=1252"}],"version-history":[{"count":0,"href":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/wp-json\/wp\/v2\/posts\/1252\/revisions"}],"wp:attachment":[{"href":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/wp-json\/wp\/v2\/media?parent=1252"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/wp-json\/wp\/v2\/categories?post=1252"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/students.bowdoin.edu\/bowdoin-science-journal\/wp-json\/wp\/v2\/tags?post=1252"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}