Meta has upgraded its Ray-Ban Meta Smart Glasses, enhancing their capabilities by enabling them to describe what you’re seeing through the built-in camera. Simply by asking the AI within the glasses about your surroundings, you can receive valuable information. For example, it can identify cat breeds, translate foreign language signs, or provide details about famous landmarks. Meta refers to this feature as “multimodal,” signifying the AI’s ability to process multiple forms of input, including voice commands and visual data. Meta explains, “We’ve been testing a multimodal AI update since December, allowing you to ask your glasses about what you’re seeing, and they’ll provide you with intelligent, helpful answers or suggestions.” This advancement expands the functionality of the glasses by granting them the ability to perceive the world around you. Imagine traveling and encountering a menu written in French. Your smart glasses can leverage their built-in camera and Meta AI to translate the text, providing you with the necessary information without the need for a smartphone or excessive screen time. However, privacy concerns limit the scope of inquiries; for instance, Meta’s AI will refrain from providing information about individuals you encounter on the street. The feature is currently undergoing beta testing and is being rolled out to all Ray-Ban Meta smart glasses users in the U.S. and Canada. To access this functionality, ensure that your glasses have the latest software update installed. Simply say “Hey Meta” and ask your question. Meta’s advancements don’t end there. The glasses now allow you to share your perspective during video calls. If you’re using WhatsApp or Facebook Messenger for video calls while wearing the glasses, you can showcase your surroundings to other participants. Meta highlights the practical applications of this feature: “At the grocery store, unsure which kombucha brand to choose? Can’t determine the ripeness of a pineapple? Now you can initiate a video call with your mom and seek her advice based on what you’re seeing.” The video-calling feature is being gradually rolled out, so you may not have immediate access to it. Additionally, Meta has expanded its frame options, which are now available in 15 countries, including the U.S., Canada, and Australia.
Meta’s Smart Glasses Now Describe What You See
