Technology that translates neural activity into speech would be transformative for people who are unable to communicate as a result of neurological impairments. Decoding speech from neural activity is challenging because speaking requires very precise and rapid multi-dimensional control of vocal tract articulators. Here we designed a neural decoder that explicitly leverages kinematic and sound representations encoded in human cortical activity to synthesize audible speech. Recurrent neural networks first decoded directly recorded cortical activity into representations of articulatory movement, and then transformed these representations into speech acoustics. In closed vocabulary tests, listeners could readily identify and transcribe speech synthesized from cortical activity. Intermediate articulatory dynamics enhanced performance even with limited data. Decoded articulatory representations were highly conserved across speakers, enabling a component of the decoder to be transferrable across participants. Furthermore, the decoder could synthesize speech when a participant silently mimed sentences. These findings advance the clinical viability of using speech neuroprosthetic technology to restore spoken communication. A neural decoder uses kinematic and sound representations encoded in human cortical activity to synthesize audible sentences, which are readily identified and transcribed by listeners.
The manipulation of acoustic wave propagation in fluids has numerous applications, including some in everyday life. Acoustic technologies frequently develop in tandem with optics, using shared concepts such as waveguiding and metamedia. It is thus noteworthy that an entirely novel class of electromagnetic waves, known as "topological edge states," has recently been demonstrated. These are inspired by the electronic edge states occurring in topological insulators, and possess a striking and technologically promising property: the ability to travel in a single direction along a surface without backscattering, regardless of the existence of defects or disorder. Here, we develop an analogous theory of topological fluid acoustics, and propose a scheme for realizing topological edge states in an acoustic structure containing circulating fluids. The phenomenon of disorder-free one-way sound propagation, which does not occur in ordinary acoustic devices, may have novel applications for acoustic isolators, modulators, and transducers.
Since the mid 1990s, acoustics research has been undertaken relating to the sound zone problem-using loudspeakers to deliver a region of high sound pressure while simultaneously creating an area where the sound is suppressed-in order to facilitate independent listening within the same acoustic enclosure. The published solutions to the sound zone problem are derived from areas such as wave field synthesis and beamforming. However, the properties of such methods differ and performance tends to be compared against similar approaches. In this study, the suitability of energy focusing, energy cancelation, and synthesis approaches for sound zone reproduction is investigated. Anechoic simulations based on two zones surrounded by a circular array show each of the methods to have a characteristic performance, quantified in terms of acoustic contrast, array control effort and target sound field planarity. Regularization is shown to have a significant effect on the array effort and achieved acoustic contrast, particularly when mismatched conditions are considered between calculation of the source weights and their application to the system.