Wearable Technology and AAC: An Overlooked Opportunity
David Banes
Key takeaways
● AAC (augmentative and alternative communication) covers symbols, communication boards, text, gestures, recorded phrases and speech-generating devices used by people whose natural speech does not meet all their communication needs.
● Public discussion of smart glasses as assistive technology has focused mainly on blind and low-vision users; their potential to support AAC users remains largely overlooked.
● Wearables will not replace established AAC systems, but could give AAC users faster, more discreet, hands-free access to language as part of a connected communication ecosystem.
● Context-aware AI could surface relevant vocabulary automatically (in a classroom, restaurant or medical appointment) — but AI suggestions must always remain reviewable, editable and rejectable by the user.
● Most current smart glasses depend on voice commands, which excludes people with unreliable, effortful or absent speech; genuine access requires switches, eye gaze, head control or wristband alternatives.
● Privacy, affordability and proprietary lock-in are significant risks that require co-design with AAC users, not a communication feature bolted onto a consumer product.
What is AAC?
AAC (augmentative and alternative communication) is an umbrella term for methods — including symbols, communication boards, text, gestures, recorded phrases and speech-generating devices — that support or replace speech for people whose natural speech does not meet all of their communication needs.
Wearable technologies, including Ray-Ban Meta glasses and other AI-enabled devices, are increasingly discussed as assistive tools. Much of that discussion has understandably centred on people who are blind or have low vision. Hands-free cameras can identify objects, read text and help describe surroundings. Meta has also promoted detailed visual descriptions and its connection with Be My Eyes volunteers, alongside hands-free calling, messaging and real-time translation.
Any discussion of smart glasses must recognise growing restrictions in schools, cinemas, theatres, clubs and other venues. Norway is considering tighter regulation rather than a national ban, which will be an important factor in the future of these devices.
Looking beyond access to visual information
These developments are important, but they have shaped the public conversation around a relatively narrow question: how can smart glasses help someone access visual information? Far less attention has been given to another possibility: how could wearables help people express themselves?
This matters for people who use augmentative and alternative communication (AAC). For this diverse community, smart glasses will not replace established AAC systems. They could, however, become a valuable part of a connected communication ecosystem.
Useful innovations for wearable technology for AAC users in the past have included
· Wearable core boards
· Proloquo2Go on Apple Watch
· GoTalk Go
· GoTalk Select/GoTalk WOW
Developments of smart glasses for AAC have also been introduced, including:
· Vocable on Apple Vision Pro
· Cognixion ONE Axon-R
Discreet and immediate access to communication
The most immediate benefit is discreet, hands-free access. An AAC user may currently need to reach for a phone or tablet, unlock it, open an app and navigate through several pages before producing a message. In a fast-moving conversation, that delay can mean the subject changes before the person has an opportunity to contribute. Glasses could provide prompts or quick access to relevant words and stored phrases without requiring the user to look away from their communication partner.
Consider a student entering a science lesson. The glasses might automatically make vocabulary such as ‘experiment’, ‘temperature’, ‘predict’ and ‘I disagree’ available through a linked AAC system. A subtle switch, head movement, eye gesture or wrist-based control could select a phrase, while a phone or speech-generating device delivers the spoken output. The goal is not to automate the student’s answer, but to reduce the effort needed to reach language that the student has chosen.
Practical applications in everyday life
Wearable AAC support could make a difference across several everyday settings:
● Medical appointments: wearable technology could display or read out a prepared list of symptoms, questions and medication information. It might transcribe the clinician’s speech, identify when a question has been asked and offer access to appropriate vocabulary. If the conversation becomes confusing, the user could quickly communicate, ‘Please slow down’, ‘That is not what I meant’ or ‘I need more time to answer.’
● The workplace: an employee with aphasia or motor neurone disease might receive a discreet reminder of agenda items during a meeting. They could prepare contributions in advance, bring them forward at the appropriate moment and signal that they have something to say.
● Variable speech: smart glasses may also support people who can speak sometimes but not reliably. Someone experiencing fatigue, anxiety, pain or variable speech could move between natural speech and AAC without making an obvious change of device. A wearable might allow them to retrieve a frequently needed phrase, ask for assistance or contact a trusted person when speaking becomes difficult.
Emerging research into wearable AAC
Research is beginning to explore this wider potential. Studies of mixed-reality and discreet AAC have examined how wearable systems might give users access to language support while allowing them to remain engaged in another activity. Researchers have also proposed wearable AAC systems combining mixed reality with eye-gaze or brain-computer interfaces. Earlier smart-glasses projects for autistic people explored real-time social and communication prompts.
The potential of context-aware AI
AI could add another layer of support. With the user’s permission, a system might recognise that they are in a restaurant and make food, drink, payment and dietary vocabulary easier to reach. It could expand a few selected keywords into a grammatically complete sentence or suggest different ways to express the same idea. For a multilingual AAC user, it might translate a message while retaining the original for checking.
However, prediction must never become substitution. An AI-generated sentence may be fluent yet fail to express what the AAC user intended. It may make a person sound more formal, positive or compliant than they wish to be. The user must always be able to review, change or reject a suggestion. Speed is useful, but authorship, personality, and the right to say something unexpected matter more.
When voice control becomes a barrier
Current smart glasses also expose a major contradiction: many rely heavily on spoken commands. This may be convenient for nondisabled customers and some disabled users, but it creates a barrier for people with unreliable, effortful or absent speech. Voice recognition may perform poorly with dysarthric or atypical speech, especially in noisy environments. Genuine AAC access therefore requires alternatives such as switches, touch surfaces, eye movements, facial gestures, head controls, partner-assisted scanning or muscle-sensing wristbands.
Privacy, affordability and integration
There are other practical and ethical challenges that any wearable AAC solution must address:
● Privacy and consent — cameras and microphones create concerns for everyone nearby, and continuous cloud processing could expose highly personal conversations, locations and health information.
● Cost and access — battery life, connectivity and cost may restrict who can use the technology.
● Cognitive load — visual prompts could distract the wearer or add mental effort rather than reduce it.
● Vendor lock-in — proprietary systems may disappear, change price or prevent integration with a person’s established AAC vocabulary.
These concerns explain why wearable AAC should not be designed simply by adding a communication feature to a consumer product. It needs co-design with people who use different forms of AAC, in different environments and with different physical, sensory, cognitive and language needs. Testing should examine whether the technology improves participation, reduces effort and supports communication repair — not merely whether it produces messages quickly.
Building a connected communication ecosystem
The opportunity is significant. Wearables could help distribute communication across several connected tools:
● Glasses for prompts and context
● A watch, switch or wristband for access
● A phone for processing
● A speaker or display for output
This could make AAC more available across positions and activities.
The next discussion about smart glasses and disability should therefore look beyond how technology can describe the world to blind people, valuable though that is. It should also ask how wearables can help AAC users question, refuse, joke, contribute, build relationships and exercise control. Smart glasses will have value for AAC only when they support people to express their own thoughts, in their own way and on their own terms.
Frequently Asked Questions
Can smart glasses replace AAC devices?
Not yet. For people who use AAC, smart glasses will not yet replace established AAC systems. Instead, they could become part of a connected communication ecosystem alongside a phone, tablet, watch, switch or dedicated speech-generating device.
How could smart glasses help someone who uses AAC?
They could provide discreet, hands-free prompts and quick access to relevant words and stored phrases, so a user does not have to reach for a phone or tablet mid-conversation — in a classroom, a medical appointment or a work meeting.
What role could AI play in wearable AAC?
With permission, context-aware AI could recognise a setting (such as a restaurant) and surface relevant vocabulary, expand keywords into full sentences, or translate messages for multilingual users. Predictions must always remain reviewable, editable or rejectable by the user, since authorship and personal voice matter more than speed.
Why is voice control a barrier for many AAC users?
Many current smart glasses rely heavily on spoken commands, which excludes people with unreliable, effortful or absent speech, because voice recognition often performs poorly with dysarthric or atypical speech, especially in noisy environments. Genuine access requires alternatives such as switches, touch surfaces, eye movements, facial gestures, head controls, partner-assisted scanning or muscle-sensing wristbands.
What are the main risks of wearable AAC technology?
Key risks include privacy and consent (cameras and microphones capture data about everyone nearby), affordability, battery life and connectivity limits, distraction or added cognitive load from visual prompts, and the risk that proprietary systems could disappear, change price or fail to integrate with a person’s established AAC vocabulary.
What would a connected communication ecosystem for AAC look like?
It could combine glasses for prompts and context, a watch, switch or wristband for access, a phone for processing, and a speaker or display for output — distributing communication support across several connected tools rather than relying on a single device.
Sources & Further Reading
● ACM — study on mixed-reality and discreet AAC
Topics: Augmentative and Alternative Communication (AAC) · Wearable Technology · Smart Glasses · Assistive Technology · Context-Aware AI · Disability Inclusion · Accessible Design