Ray-Ban Meta Smart Glasses Now Feature Multimodal AI Capabilities

The latest Ray-Ban Meta smart glasses, an upgrade from the Ray-Ban Stories launched in September 2023, have been equipped with advanced multimodal artificial intelligence (AI) capabilities. Meta recently announced the update’s availability on Tuesday for users in the US and Canada. The AI integrated into the Ray-Ban Meta smart glasses boasts multimodal functionalities, enabling users to identify objects captured through the device’s camera. Moreover, Meta has introduced new frame styles for the smart glasses and incorporated a video calling feature. Meta announced the updates via a post on its newsroom, highlighting the smart glasses’ voice command control with the prompt “Hey Meta,” granting users access to real-time information. While Meta has yet to confirm if the AI within the smart glasses is powered by its Llama 3 foundation model, the company plans to introduce the latest model’s capabilities soon. Meta initially commenced testing the AI features in December 2023, initially releasing them to a select group of beta users. However, the AI capabilities are now available to all users in the US and Canada. While the Ray-Ban Meta smart glasses are currently available in 13 additional countries, Meta remains silent on the availability of AI features in those regions. According to a report by The Verge, the activation of the AI feature differs from Meta’s advertised “Hey Meta” prompt, with the actual working phrase being “Hey Meta, look and…” followed by the desired information query. Using the AI feature is straightforward; to identify a flower, plant, or car model, simply look at the object and ask Meta AI, and the device should provide the requested information. Additionally, users can inquire about non-visual topics, and the AI should be able to answer those as well. Along with the new AI capabilities, the wearable device now supports video calling through Meta apps, allowing the recipient to experience the smart glass wearer’s perspective. Meta has also unveiled new frame styles for the smart glasses, including the Skyler frame and the Headliner low bridge fit frame.