Esync Design Team · CLIENT: E-Sync
E-sync is a wearable communication aid for people with hearing loss, using AI to analyze speech and emotions. It converts speech content and emotions into text and tactile vibrations for users to understand the speaker’s tone. Users can respond in sign language, which is converted to speech messages through AI. The device’s foldable design is convenient and protective, with an elegant color scheme that blends with daily attire. The accompanying app allows for language processing customization in real-time, enhancing the communication experience for users in social interactions.
Press Kit
- Unique Properties
- E-sync, AR smart glasses for the hearing impaired, aims to improve emotion recognition and expression in interpersonal communication. E-sync uses AI hardware to analyze speech and gestures, generating visual and auditory feedback through AR technology. It adapts to social contexts and emotional signals, enhancing communication for the hearing impaired and reducing misunderstandings.
- Dimensions & Packaging
- 150mm x 155mm x 38mm
E-sync's unique lens storage design adds convenience and protection, while its elegant color scheme and material combination enhance comfort and style, making it both functional and fashionable. Moreover, the accompanying app E-connect, allows for real-time language processing adjustments, ensuring convenient usage. - Tags
- AR glasses, Hearing-impaired people, Emotional expression, AI Hardware, Smart Wearable Technology
- Production Technology
- The introduction of AI technology into E-sync enhances face-to-face communication for the hearing-impaired. It recognizes speech content and emotional cues, converting them into text and tactile feedback. Users can respond using sign language, which the device converts into suitable speech based on gesture recognition. This closed-loop communication process, aided by AI hardware, reduces misunderstandings, and improves social interactions.
- Design Challenge
- We extensively considered the shape and size of the product during the design process, exploring options like smartphones and smartwatches, but ultimately choosing glasses as the most convenient option. We also considered privacy concerns during communication between individuals with hearing loss and hearing individuals, addressing these issues in our design of aesthetics and functionalities.
- Project Duration
- The project started in January 2024 in Beijing and finished in March 2024 in Beijing.
- Operation Flow
- E-sync utilizes AI to analyze the speech information of the hearing population, generating visual information, which is then presented to the user through augmented reality technology on the lenses of the glasses. Additionally, the product scans sign language gestures through cameras and translates them into corresponding phrases. Based on the user's social occasions and physiological signals related to personal emotions, AI processes and outputs complete sentences through the speaker.
- Research
- 60.5M+ individuals with severe to total hearing loss struggle with conventional aids, limiting access to info & effective communication. Current assistive devices mainly convert speech-to-text, ignoring the depth of understanding and emotional conveyance crucial in social interactions. This barrier exacerbates isolation, discrimination, and mental health concerns in a hearing-centric society.
- Inspiration
- People with disabling hearing loss face limitations in accessing auditory cues, resulting in lower emotional cognition compared to hearing individuals. This lack of emotional understanding can lead to misunderstandings in social interactions and difficulties in conveying true emotions and attitudes. Consequently, it may cause offense or awkwardness, leading to misunderstandings and inconvenience.
Press releases are available in 1 languages.