SNSボタン

SoftBank Corp.’s “SureTalk” Converts Sign Language and Speech into Text to Surmount Communication Barriers

SureTalk

The need to communicate with others who use different languages is universal. Ongoing technological advances in machine translation software are gradually closing the communication gap to enable conversations among those who speak different foreign languages. To make sign language more accessible, however, much still needs to be done.

Overcoming the communication gap is especially important when it comes to sharing information necessary for daily life or when there is an emergency. To meet this need, The University of Electro-Communications, a Tokyo-based national university, and SoftBank Corp. (TOKYO: 9434) jointly developed “SureTalk,” a communication platform that enables smooth interactions between Signed Japanese users and those who use regular speech.

Screen-based communication tool can be used anytime, anywhere

SureTalk, which uses AI to continuously learn and improve, tracks manual articulations used in Signed Japanese, extracts characteristics and converts them into text. People with regular hearing abilities speak verbally, and their voice data is converted into text to enable two-way communication.

Since large amounts of data are required to recognize Signed Japanese with AI, SureTalk efficiently stores increasingly larger volumes of data to improve its AI-based recognition. Users can easily start a one-on-one conversation by logging into SureTalk, tapping the “Start Talking” button and choosing their language mode (Sign Language or Voice) before entering a conversation room.

SureTalk

SureTalk is already being used on a trial basis at the City Hall of Mito City, a large city approximately 100km northeast of Tokyo, to facilitate communication with residents who use Signed Japanese. SureTalk is also being used at social welfare facilities to garner feedback and improve the service.

Contributing to the Sustainable Development Goals (SDGs) is a top managerial priority for SoftBank, and the company is offering SureTalk free-of-charge to help achieve Goal 8 (Decent Work and Economic Growth), Goal 9 (Industry, Innovation and Infrastructure), Goal 10 (Reduced Inequality), Goal 11 (Sustainable Cities and Communities) and Goal 17 (Partnerships for the Goals).

In collaboration with the University of Electro-Communications and business partners, SoftBank will work to further improve and promote the spread of SureTalk so people with hearing impairments can communicate with greater ease and convenience.

(Posted on November 9, 2021)
by SoftBank News Editors