Le Lézard
Classified in: Health, Science and technology
Subjects: CHI, DIS, DEI

Evolving Speech Technologies: InnerVoice Unreal App. The System Behind The InnerVoice Unreal App


Elara Systems collaborated with iTherapy to develop a new communication training tool for children with autism on mobile applications. The app ? InnerVoice Unreal ? creates an engaging and entertaining space for typical and neurodiverse children to find their voice. Powered by Unreal Engine, our developers at Elara were focused on bringing iTherapy's communication training to a mobile platform.

GOLD RIVER, Calif., May 23, 2022 /PRNewswire-PRWeb/ -- Elara Systems collaborated with iTherapy to develop a new communication training tool for children with autism on mobile applications. The app ? InnerVoice Unreal ? creates an engaging and entertaining space for typical and neurodiverse children to find their voice. Powered by Unreal Engine, our developers at Elara were focused on bringing iTherapy's communication training to a mobile platform.

InnerVoice Unreal was designed as a mobile application dedicated to improving the quality of life for people who struggle with communication challenges. Children with autism can often find it difficult to learn the intricacies of speech through face-to-face interactions due to a reluctance to make eye contact or engage in interpersonal communication. In turn, InnerVoice aims to provide a communication and speech therapy application that bypasses existing behavioral barriers. Through this tool, users can tap emojis and type out text to make 3D characters speak the selected words and emote back to them, helping to develop valuable communication skills. To bring this app to life, Elara's foundational solution required the creation of customizable 3D animated avatars to replicate human emotions, facial expressions, and speech movements in order to ensure the efficacy and accuracy needed for speech therapy.

Avatar Customization
The ability for users to customize their avatar's voice and character was integral to ensuring a strong foundation for this speech therapy application. Stellar character modeling was at the root of the initial push for development, with creative minds focused on depicting a variety of friendly, childish faces. During their creative iteration, Elara's engineers worked to integrate Amazon's cloud computing into Unreal Engine 4, giving them access to the latest in modulated voice-synthesis technology. The resulting framework proved to be an important first step towards success.

Voice-Synthesis
When bringing these characters to life, our animators had to pay close attention to how the face and mouth moves as each new sound is formed. Referred to as visemes, these distinct shapes are the key behind comprehensive lip reading. After extensive effort was taken to ensure proper readability, the visemes were paired to the phonetic enunciation of each character's speech. The result was a robust and reliable system that would allow for the procedural application of speech movements, to maximize accuracy and visualization.

Dynamic Emotions
Phonetic enunciation, however, was only one portion of what the InnerVoice Unreal App aimed to depict. Many children with autism often struggle to learn facial expressions and speech articulation independently. As such our animators were tasked with ensuring that our characters depict an extensive range of emotions, which could then be blended into our visemes.

When all of the application's various components are pieced together, the InnerVoice Unreal application provides a fun, simple system that is easy to learn and navigate. Its procedural lip-syncing and speech synthesis make for a powerful tool when combined with its approachable, stylized characters. Elara Systems made great use of the Unreal Engine platform by Epic Games, to provide optimized visuals on a mobile-friendly application. With a strong background in VR technology and 3D animation, Elara is proud to support iTherapy in its progress towards evolving, evidence-based practices.

About Elara
Based in Northern California, Elara Systems is a strategic creative agency that develops digital content for medical and industrial markets across the globe. For 20 years, Elara has partnered with clients to develop creative solutions to showcase their vision and transform digital content mediums ? including virtual reality, mixed and augmented reality, 3D, and video. They specialize in creating deeply interactive experiences for teaching, training, marketing and sales. For more information, all parties should contact Melissa Herbold at [email protected].

About iTherapy
iTherapy is a San Francisco Bay Area company dedicated to improving quality of life for people who struggle with communication challenges through a combination of evidence-based practices, evolving technology, engagement, and fun.

Media Contact

Matt Pope, XR Technical Artist, Elara Systems, 1 916-638-1658, [email protected]

 

SOURCE Elara Systems


These press releases may also interest you

2 jui 2022
The value of trade between the Hong Kong Special Administrative Region (HKSAR) and the Chinese mainland has surged more than sixfold from $50.77 billion to $360.33 billion, an average annual increase of 8.5 percent since the Hong Kong's return to the...

2 jui 2022
Premier Tech Home Security, a leader in providing security systems to homes in businesses in Middle Tennessee, is proud to announce the launch of their new website. Though the company offers their services across a wide geographic area, customers can...

2 jui 2022
Peng Liyuan, wife of Chinese President Xi Jinping, on Thursday visited the Xiqu Center in Hong Kong's West Kowloon Cultural District, a venue for the art of Chinese traditional theater.  She watched rehearsals of Cantonese opera performances and a...

2 jui 2022
Milloret LTD, a prestigious UK-registered European SEO Agency operating from the UK, and Spain announced today its mission to offer international SEO services to help grow clients' businesses. Milloret LTD  specializes in helping websites perform...

2 jui 2022
DesignMap, the industry-leading digital product design consultancy, is undertaking a strategic multiyear growth plan. The company, which has been providing strategic design services for leading Silicon Valley tech companies since 2006, not only...

2 jui 2022
In the Hype Cycle for Privacy, 2021, Gartner recognized Prime Factors among Sample Vendors in Privacy, a space that is a top priority for security and risk management leaders managing technology, information and resilience risk. For Format-Preserving...



News published on 23 may 2022 at 10:00 and distributed by: