If you're a Windows Insider, you can try this feature by clicking the glasses icon in the Copilot app, selecting the browser or app you want to share the screen with, and then asking Copilot to help you out. This feature is rolling out to Windows Insiders in the United States, and it might sound like a creepy idea because it basically means Copilot can see what you are doing on your screen—if you choose to share it with the AI app. When you share your screen with AI, Copilot can then help analyze, offer insights, answer your questions, and speak to you in real time. It's unclear how Copilot Vision processes your screen data, but remember it's cloud-based, and Microsoft is not relying on local AI models for this integration. Copilot on Windows 11 is testing OS-level integration that would allow you to share your favourite apps' screen with Copilot. For example, you might want to share your screen with Copilot Vision because it can help you navigate the app if you're struggling with it. At the moment, Copilot Vision (screen share) and File Search features are gradually rolling out in the Windows Insider Program. If you're in the Settings app and unable to find a specific option, Copilot Vision can show you where to locate that particular toggle in real time. In a blog post, Microsoft noted that Copilot on Windows 11 can already read .docx, .xlsx, .pptx, .txt, .pdf, and .json files. You can use everyday language to ask Copilot questions like “Can you find my resume?” and Copilot will find the resume.docx for you by scanning your PC's storage. As I mentioned at the outset, Microsoft hasn't clarified how the data is being processed or encrypted, but we'll likely learn more about the privacy policies when the feature exits the testing program. You can stop sharing your screen by clicking the Stop button or 'X' in the Copilot app.
This Cyber News was published on www.bleepingcomputer.com. Publication date: Wed, 09 Apr 2025 22:45:15 +0000