Microsoft has began testing a brand new replace to its Copilot app on Windows that may allow you to share your display or apps with the AI assistant. Copilot Vision was initially restricted to Microsoft’s Edge browser, nevertheless it’s now extending to any app in your PC.
Copilot Vision will be capable of do issues like coach you thru utilizing Adobe Photoshop options, or analyze the pictures and webpages you’re taking a look at. I bought to see an early model of Copilot Vision on Windows at Microsoft’s fiftieth anniversary celebration final week, the place the AI assistant guided me by means of a sport of Minecraft and helped to optimize settings in Microsoft’s Clipchamp video editor.
I haven’t been in a position to totally check Copilot Vision on Windows by means of the Insider beta as a result of Microsoft is limiting the expertise to US testers solely. Copilot will be capable of spotlight elements of your display to information you thru apps, though this preliminary beta model received’t have the characteristic enabled simply but. Copilot Vision would possibly sound just like Microsoft’s Recall characteristic that routinely takes snapshots when you enable it, nevertheless it’s truly extra like display sharing an app or your total desktop in a Microsoft Teams name.
Microsoft has additionally began testing file search in Copilot on Windows, permitting you to ask the AI assistant concerning the contents of a file in your PC. File search helps .docx, .xlsx, .pptx, .txt, .pdf, .json information, and you should use Copilot to simply discover the paperwork you have been engaged on not too long ago.
Both of those Copilot options simply require the Copilot app on Windows, and never a full Copilot Plus PC. You may use Copilot Vision on iOS and Android. Microsoft has began testing these new Copilot options with Windows Insiders, forward of a broader rollout to all Windows 11 customers within the coming weeks or months.