Imagine a world where your web browser can actually understand what you’re doing and help you out in real time. That’s the vision behind Microsoft’s new Copilot Vision feature, built right into Microsoft Edge. Copilot Vision, powered by AI, essentially “sees what you see, and hears what you hear” as you browse the web.
But this isn’t just some creepy AI snooping for fun. Copilot Vision analyzes your browsing activity to answer your questions, suggest relevant content, and even summarize what you’re reading. Imagine asking Copilot about a movie you’re looking at on Rotten Tomatoes, and getting personalized recommendations based on your tastes. Microsoft demonstrated this by suggesting an Australian comedy to an Australian user, recognizing their location and preferences.
Of course, the idea of an AI watching everything you do online might make some people uneasy. Microsoft acknowledges this and assures users that Copilot Vision is completely opt-in. You have to manually enable the feature, and you’ll see a clear indicator when it’s active, letting you know that it’s watching your browsing. Microsoft also emphasizes that data from your browsing sessions is deleted once you close the session and isn’t used for training the AI. Additionally, Copilot Vision is initially limited to specific websites, and won’t work on paywalled or sensitive content.
Beyond just analyzing what you’re looking at, Copilot Vision also works in conjunction with Copilot Voice, another feature that allows you to interact with the AI using your voice. Now, you can have conversations with Copilot across desktop and mobile devices, asking questions, getting information, and even setting reminders.
To further enhance your daily experience, Microsoft is introducing Copilot Daily, a personalized morning news show. Imagine a personalized voice briefing you on the day’s news, traffic, and weather, all tailored to your interests and browsing behavior. This generative AI voice is designed to provide a customized daily update, keeping you informed and ready for the day ahead.
Copilot Voice and Copilot Daily are currently rolling out to Windows users in the US and UK. Voice is also available in Australia, Canada, and New Zealand, but only in English. Microsoft plans to expand the feature to more countries and languages soon. Copilot Vision, on the other hand, is beginning its rollout today in the US, but only for Copilot Pro subscribers. This new feature is part of Microsoft’s Copilot Labs program, which gives Pro subscribers early access to experimental AI features, allowing them to try out cutting-edge technology before it becomes widely available.
