Expressive Captions are part of Live Caption, so they’re built into the operating system and available across apps on your phone. This means you can use Expressive Captions with most things you watch, like livestreams on social platforms, memories in your Google Photos reel and video messages from friends and family. When enabled, captions will occur in real time and on device, so you can use them even while you’re on airplane mode.
Bringing Expressive Captions to life
To build Expressive Captions, our Android and Google DeepMind teams worked to understand how we engage with content on our devices without sound. Using multiple AI models, Expressive Captions not only captures spoken words but also translates them into stylized captions, while providing labels for an even wider range of background sounds. This makes captions just as vibrant as listening to audio. It’s just one way we’re building for the real lived experiences of people with disabilities and using AI to build for everyone.
Starting today, Expressive Captions will be available in the U.S. in English on any Android device running Android 14 and above that has Live Caption. This is part of our work to find even more ways to bring emotional expression and context to captions.