.

Scientists Say Their AI Can Translate Human Thoughts Into Speech

Neuro-engineers at New York’s Columbia University say they have created a system that can translate human thoughts into recognizable speech,...

Neuro-engineers at New York’s Columbia University say they have created a system that can translate human thoughts into recognizable speech, which would revolutionize not just medicine but communication.

By monitoring brain activity of subjects, the researchers at Columbia’s Mortimer B. Zuckerman Mind Brain Behavior Institute were able to train artificial intelligence to translate thought patterns into intelligible sentences, says a paper published on Tuesday in the journal Scientific Reports.

The authors see patients with speech impaired by disease or trauma as first adopters of the incipient technology.


“We've shown that, with the right technology, these people's thoughts could be decoded and understood by any listener,” said Dr. Nima Mesgarani, the paper’s senior author.

After the researchers’ early attempts to translate brain activity into recognizable speech failed, they turned to a computer algorithm that can generate speech, called a vocoder. The algorithm improves the more it is “trained” by recordings of human speech.
“This is the same technology used by Amazon Echo and Apple Siri to give verbal responses to our questions,” said Dr. Mesgarani, who is also a professor at Columbia's Fu Foundation School of Engineering and Applied Science.

The vocoder was trained to interpret brain activity with the help of Dr. Ashesh Dinesh Mehta, a neurosurgeon at Northwell Health Neuroscience Institute in Long Island, and the paper’s co-author.

“Working with Dr. Mehta, we asked epilepsy patients already undergoing brain surgery to listen to sentences spoken by different people, while we measured patterns of brain activity,” said Dr. Mesgarani. “These neural patterns trained the vocoder.”
After this training was done, the next phase started. The patients listened to a person reading numbers from 0 to 9 while the algorithm scanned the brain activity and tried to translate it into sound. The result was a robotic voice reading numbers, which human listeners could understand and repeat with about 75-percent accuracy.

This may seem quite modest, but Dr. Mesgarani said such a result is “above and beyond any previous attempts.” The researchers plan to improve the system further, so that it could take as input brain patterns of a person thinking about speech, not actually listening it.

“This would be a game changer. It would give anyone who has lost their ability to speak, whether through injury or disease, the renewed chance to connect to the world around them,” Dr. Mesgarani said.

The technology will also need to work with more complex words and sentences to become more practical. The ultimate goal for the team is to create an implant that would synthesize speech directly from thought.

Source: RT.com / Cover image: Brain-Computer Interface (BCI) contest at the World Robot Conference (WRC) in Beijing, China © Reuters/Jason Lee

Subscribe for daily articles:

Related

Science 6341941472626581749

Follow HAF

One time contribution

Become A Patron

Sponsor

recommended

Subscribe

Subscribe for daily articles:

Translate

Sponsors

Recommended

Tag cloud

5G Dangers (56) About me (3) Agenda 2030 (18) Alzheimer's (14) Archons (8) Art. in German (33) Ayahuasca (13) Big Brother (122) Big Pharma (38) Bilderberg (25) Bill Gates (14) Black Knight (2) Brexit (1) Brzezinski (1) Caeli Francisco (24) Cancer (360) Censorship (65) Chemtrails (84) Child Trafficking (3) Clinton (55) Cold War 2 (61) Consciousness (31) Conspiracy (1181) Control (1069) Cosmos (219) Crisis Actors (8) Crop Circles (10) Crystal Skulls (1) Deep State (5) Dejan Davchevski (29) Demonic Possession (6) Depopulation (158) Detox (2) Diabetes (7) Disney (6) Documentaries (156) DuPont (2) Ebola (5) Education (99) EMP Dangers (1) Empaths (39) ETs UFOs (628) Evil Corporations (2) False Flags (141) Fasting (10) FEMA (4) Feminism (12) Finance (190) Fluoride (29) Forbidden History (610) Free Energy (63) Free Spirit (8) Freemasonry (15) Fukushima (63) Geoengineering (84) George Soros (35) Giants (1) Global Warming Hoax (63) GMO (65) Grounding (7) Guest Writers (5) HAARP (21) Healthcare (1843) Hemp (149) Henry Kissinger (5) Hollow Earth (20) Illuminati (71) Inspiration (774) Inspirational Public Figures (32) Internet of Things (10) JFK (18) Julian Websdale (17) Julie Alexander (29) Khali Carol (7) Laura Jane (3) Lisa Morris (1) Lucy Alvet (2) Makia Freeman (4) Mandela Effect (6) Mari A. Raphael (2) Mark Nestmann (12) Medical Kidnapping (16) Meditation (24) Michael Martin (6) Microchip Implant (23) Migrant Crisis (49) Mind Control (148) Monsanto (64) MSM (104) Mysteries (495) News (1357) Nikola Tesla (20) Nuclear Hazard (53) NWO (308) Occult Knowledge (58) OOPArt (15) Orlando Shooting (5) Papal Bloodlines (1) PhD Anonymous (22) Pienaar Arno (16) Pineal Gland (15) PizzaGate (9) Planet X (5) Podesta (1) Pole Shift (11) Police State (80) Political Correctness (1) Preppers (30) Project MKUltra (36) Propaganda (53) Pyramids (75) Q and A (5) Quotes (14) Recent Articles (7651) Reincarnation (57) Religion (6) Rene’ Descartes (11) Rockefeller (25) Rothschild (81) Sacred Geometry (1) Sacred Water (8) Satanism (90) Satanist Pedophiles (379) Science (205) Secret Societies (43) Secret Space Program (20) SJW (1) Smart Meters (1) Spirituality (1070) Sponsor Books (3) Stephanie MacDonald (3) Strange Murders (3) Subscribe (1) Sun-gazing (2) Sustainable Housing (6) Symbolism (2) Synchronicity (9) The Anunnaki (115) The Bush Family (6) The Matrix (122) The Vatican (54) Time Travel (11) Transgender Agenda (12) Transhumanism (7) TROLLS (8) Vaccines (257) Videos (268) Voting is Rigged (23) War (104) War on Cash (6) War on Drugs (17) Weather Terrorism (1) Wheatgrass (1) Wi-Fi Dangers (44) Wisdom (50) WTC (9/11) (74) Zephyr Prayers (3) Zika Virus (16) Zionism (13) Zodiac (12)

Sponsor

Pageviews

item