Meta’s latest firmware update introduces live artificial intelligence (AI) and real-time translation for its smart glasses in the United States. Early Access members will have access to these new features.
Meta’s new AI will record your view for interaction without needing a wake word like “Hey Meta.” Additionally, live translation between English and Spanish, French or Italian video translation services can also be provided.
Live AI
Now, owners of Meta’s Ray-Ban smart glasses can ask their AI to assist with cooking, gardening and other tasks without holding up their phone to get assistance. Today’s release of version 11 software update brings two long-awaited AI features announced at Connect 2024 event by Meta.
Live AI is a video version of Look and Ask that lets the Meta AI observe what it can through your camera, before communicating in real-time about those items with you. A session can begin by saying simply, “Hey Meta.” With time, it may even provide helpful suggestions before being asked directly by you!
Live Translation is another new feature, providing real-time speech translation between English and Spanish, French or Italian in real time. These capabilities are now available to members of Meta’s Early Access Program in both the US and Canada.
Live Translation
Ray-Ban Meta smart glasses (review) now support several AI features announced at Meta Connect 2024, such as video version of Look and Ask feature which allows continuous conversation with assistant, real-time translation capabilities and integration of Shazam music database.
The video look-and-ask functionality provides a virtual snapshot of an individual’s surroundings, using AI technology that understands context. Queries range from suggesting ingredients for recipes to identifying objects or scenes seen during video calls.
Travelers looking to expand their experience abroad will welcome Meta’s v11 update as it introduces real-time translation from English into Spanish, French and Italian – accessible either through open-ear speakers on their glasses or within their app – or Shazam integration to automatically detect music playing nearby without manually prompting it. These hands-free features are just the start of what Meta anticipates becoming an evolving set of features for its wearables.
Shazam
Meta recently introduced several key upgrades to its smart glasses that will make them even more useful, starting Monday when its v11 software update began rolling out – offering always-on continuous AI assistance, according to CNET.
Augmented reality specs come equipped with Live Translation capabilities that let you instantly translate foreign-language conversations. When speaking to someone speaking Spanish, French, or Italian the smart glasses will automatically translate their words into English through open-ear speakers before providing a transcript on your paired phone.
The v11 update introduces Shazam support for Metas, so you can ask them to identify any music playing around you. Simply say, “Hey Meta, what song is this?” and it should attempt to identify it for you. Unfortunately this feature is only currently available to Early Access program members; however Meta is working towards expanding it for all users by 2025.
Availability
Meta Connect 2024 showcased several features which are now rolled out to users of Meta’s smart glasses: live AI, live translation and Shazam integration are part of version 11 software update.
Meta’s live AI feature enables wearers to maintain a conversation with its artificial intelligence assistant while it monitors their surroundings, offering answers or making useful suggestions even before being asked for. Wearers may ask questions or interrupt at any time; their previous conversations can also be referenced at any point. Meta believes this feature may provide useful suggestions even before wearers ask.
Live Translation lets users easily translate speech between English and Spanish, French or Italian in real-time without using their hands – these translations can be heard through open-ear speakers on Meta Glasses or seen as transcripts on smartphones. With Shazam support enabled on these glasses, just ask: “Hey Meta, What Is This Song” to find out who created that particular tune!