Get the latest tech news
Copilot on Windows 11 is gaining the ability to see and interact with your apps
Copilot Vision is coming to Windows 11, enabling the AI assistant to view what's on your screen, offer helpful suggestions and actions, and even "interact" with apps.
Microsoft has announced a new feature coming very soon to the Copilot app on Windows 11 that will allow it to see and interact with what's on your screen across the OS. The feature is called Copilot Vision, which first debuted in Microsoft Edge last year, but is now coming to Windows 11 as a whole. Interact in this case means highlight buttons and areas for the user to select, not directly control the app itself.
Or read this on r/technology
