You might soon be able to communicate with machines without talking
Last month, a team of scientists led by Edward Chang from the University of California in San Francisco, found a way to decode specific signals in the brain that convert our thoughts into words. By understanding these signals, they’re making tentative steps towards merging our minds with machines. Just like with anything else, change is exciting, especially technological advances transforming the medical field, but when it comes to the human brain, a part of me can’t help but fear what’s to come.
The outcome of this research could lead to are endless opportunities, such as creating a system that could help severely paralysed people speak. This same technology could equally be used for more trivial purposes, like mentally dictating texts and sending them from your phone—drunk texting is about to get way worse. Using this technology to help paralysed people should be more important than creating another way for us to be texting non-stop. Although I must admit, sending text messages without picking up my phone sounds intriguing.
Talking is not something we usually stop and think about, it just comes out. What really happens is that your brain sends signals to your lips, tongue, jaw, and larynx to produce whatever you’re about to say. Edward Chang and his team used electrodes, placed on the brain’s surface, to record those signals. They then entered the signals into a computer model of the human vocal system for it to generate synthesised speech.
At the moment, the technology is far from becoming widely used or even accepted, as according to Chang, this technology is not able to work with electrodes placed outside of the brain, meaning that for now, people will have to undergo neurosurgery in order to put electrodes on the surface of the brain.
In the U.S. again, but on the East Coast this time, at Columbia University in New York City, researchers started testing a potentially transformative system that could help people using hearing aids by amplifying the voice they want to listen to and blocking any background noises. To understand exactly what the listener wants to hear, it uses electrodes placed on the section of the brain that processes sounds (the auditory cortex). As the brain focuses on each voice, it generates a specific electrical signature for each speaker.
The researchers at Columbia University then created a deep-learning algorithm that was trained to differentiate voices and look for the closest match between this electrical signature and the ones of the many speakers in the room. Once the algorithm’s choice is made, the hearing aid would just amplify the voice that matches best—doing so with an average accuracy of 91 percent.
Although this system is only a trial for now, one obvious stumbling block could already be a worry for potential users: just like the first research mentioned, to implant the electrodes, patients would have to undergo brain surgery—a very risky operation. Additionally, this technology could end up being used for the wrong purpose. What if people without hearing impairment used it to boost their ability to focus on one voice; to listen to private conversations? Call me a pessimistic but in this day and age, trusting technology with our privacy has been proven to be hazardous at best, so going ahead and getting it implemented inside our brains seems extremely dystopian.
The concern surrounding these two studies can be similarly raised about any new upcoming invasive technology that would require researchers to come anywhere near our brain. If further developed, this technology could be perfected and the chances of anything going wrong reduced, but what if, sometimes, pushing scientific boundaries goes too far? We’ve reached a stage where almost nothing seems impossible. Surely this level of invasion should come with ethical boundaries—let’s learn from our past mistakes.
