Teema 13. ML and AI assisted Auto-captioning and speech generation - support solutions for communication impaired people.
ML - Machine Learning
AI - Artifical Intelligence
Number of people with communication disabilities in the world counts in millions. A bit more precisely it could be calculated as 364 million people in the world, or 4.8% of the total world population. Number of people with hearing disabilities in the world could be roughly calculated as 266 million people. Of course not everyone of these millions of people have an access to YouTube or speak major languages, but roughly a quarter of worlds population has access.
Therefore, it can be calculated that quarter of 364 million people and quarter of 266 million people, 91 million and 66 million people in the world might have benefited from one of support solutions introduced by YouTube/Google a few years ago.
Auto-Captioning.
Launched in 2009 this is not the most innovative solution by now, but easily one of the most widely used, and unquestionably have made lives of many many millions of people with hearing problems bit easier.
One of the persons involved in making this technology into live is Product Owner Liat Kaver at YouTube, a deaf person herself. The technology she drove forward combined Google's automatic speech recognition technology with the YouTube caption system. It used machine learning and artificial intelligence to analyze huge data sets YouTube and Google already has, and despite still some errors and mishaps, the produced captions (sub-titles) are massive improvement for people who had not being able to understand what was said in the videos before.
ACAT - Assistive Context-Aware Toolkit
Second amazing project is a speech recognition technology - ACAT, made by Intel for Dr. Stephen Hawking and made freely available as open source (link on github)
his technology made possible for severely impaired Hawking dramatically improve speed of his communication to outside world: "it used artificial intelligence to analyze Hawking’s own words, and then used that information to help him express new ideas. By processing Hawking’s books, articles and lecture scripts, the system got so good that he did not even have to type the term people most associate with him, “the black hole.” When he selected “the,” “black” would automatically be suggested to follow it, and “black” would prompt “hole” onto the screen. "
Supportive technology not only improved the quality of lives, but even more importantly, allowed the knowledge and energy of Stephen Hawking, trapped in his failing body, to be released and produced, to the benefit of the whole world, more of his brilliant books and scientific works.
Sources:
1. https://theconversation.com/the-technology-that-gave-stephen-hawking-a-voice-should-be-accessible-to-all-who-need-it-93418
2. https://www.engadget.com/2017-02-16-youtube-one-billion-automatic-caption-videos.html
3. https://disabilitycompendium.org/sites/default/files/user-uploads/2017_AnnualReport_2017_FINAL.pdf
AI - Artifical Intelligence
Number of people with communication disabilities in the world counts in millions. A bit more precisely it could be calculated as 364 million people in the world, or 4.8% of the total world population. Number of people with hearing disabilities in the world could be roughly calculated as 266 million people. Of course not everyone of these millions of people have an access to YouTube or speak major languages, but roughly a quarter of worlds population has access.
Therefore, it can be calculated that quarter of 364 million people and quarter of 266 million people, 91 million and 66 million people in the world might have benefited from one of support solutions introduced by YouTube/Google a few years ago.
Auto-Captioning.
Launched in 2009 this is not the most innovative solution by now, but easily one of the most widely used, and unquestionably have made lives of many many millions of people with hearing problems bit easier.
One of the persons involved in making this technology into live is Product Owner Liat Kaver at YouTube, a deaf person herself. The technology she drove forward combined Google's automatic speech recognition technology with the YouTube caption system. It used machine learning and artificial intelligence to analyze huge data sets YouTube and Google already has, and despite still some errors and mishaps, the produced captions (sub-titles) are massive improvement for people who had not being able to understand what was said in the videos before.
ACAT - Assistive Context-Aware Toolkit
Second amazing project is a speech recognition technology - ACAT, made by Intel for Dr. Stephen Hawking and made freely available as open source (link on github)
his technology made possible for severely impaired Hawking dramatically improve speed of his communication to outside world: "it used artificial intelligence to analyze Hawking’s own words, and then used that information to help him express new ideas. By processing Hawking’s books, articles and lecture scripts, the system got so good that he did not even have to type the term people most associate with him, “the black hole.” When he selected “the,” “black” would automatically be suggested to follow it, and “black” would prompt “hole” onto the screen. "
Supportive technology not only improved the quality of lives, but even more importantly, allowed the knowledge and energy of Stephen Hawking, trapped in his failing body, to be released and produced, to the benefit of the whole world, more of his brilliant books and scientific works.
Sources:
1. https://theconversation.com/the-technology-that-gave-stephen-hawking-a-voice-should-be-accessible-to-all-who-need-it-93418
2. https://www.engadget.com/2017-02-16-youtube-one-billion-automatic-caption-videos.html
3. https://disabilitycompendium.org/sites/default/files/user-uploads/2017_AnnualReport_2017_FINAL.pdf
Comments
Post a Comment