Microsoft Copilot Studio Reveals New “Computer Use” Feature to help pave the way for Next-Generation UI Automation with AI
Dave W. Shanahan 3 minutes read
Microsoft has announced a major leap forward in business automation with the early access release of computer use in Microsoft Copilot Studio, its low-code AI agent platform. This new feature allows Copilot agents to interact directly with any website or desktop application, using simulated clicks, keystrokes, and menu selections—just like a human user. By bridging the gap between traditional API-based automation and the real-world interfaces businesses rely on, Microsoft is redefining what’s possible for enterprise AI and robotic process automation (RPA).
What Is “Computer Use” in Copilot Studio?
Computer use is a powerful new capability that enables Copilot agents to treat any system with a graphical user interface (GUI) as a tool. Agents can now automate workflows by clicking buttons, selecting menus, and entering data into fields on both web and desktop applications—even when no API integration exists. As Charles Lamanna, Microsoft’s Corporate Vice President for Business & Industry Copilot, puts it: “If a person can use the app, the agent can too.”
This breakthrough means Copilot Studio agents can:
- Automate data entry across legacy and modern systems.
- Conduct market research by navigating and extracting data from online sources.
- Process invoices by extracting and inputting data into accounting platforms.
- Interact with applications in real time, adapting instantly to UI changes without breaking workflows.
How Computer Use Transforms Automation
Unlike traditional RPA solutions, which often break when UI elements change, Copilot Studio’s computer use feature leverages advanced AI reasoning. Agents automatically adapt to changes in app layouts or website designs, ensuring uninterrupted automation. This resilience is coupled with robust security and compliance frameworks, keeping enterprise data safe within Microsoft Cloud boundaries and ensuring it is not used to train external AI models.
The feature is fully hosted on Microsoft’s infrastructure, eliminating the need for organizations to manage their own RPA servers. This not only accelerates deployment but also reduces maintenance and infrastructure costs, making enterprise automation more accessible and cost-effective.
Key Use Cases for Businesses
Microsoft highlights several high-value scenarios where computer use delivers immediate benefits:
- Automated Data Entry: Agents can handle large-scale data transfers between disparate systems, reducing manual effort and errors.
- Market Research: Marketing teams can automate the collection and analysis of online data, gaining insights without manual browsing.
- Invoice Processing: Finance departments can streamline invoice data extraction and entry, accelerating the entire accounting workflow.
Making RPA Smarter and More Intuitive
With computer use, Microsoft Copilot Studio is democratizing automation. Users can describe automation tasks in natural language—no coding required—and test them using real-time video previews of the agent’s reasoning and UI actions. This makes sophisticated automation accessible to non-developers and business users, not just IT specialists.
Other standout features include:
- Real-time adaptation: Agents keep working even as buttons or screens change.
- Intelligent decision-making: Agents “see” what’s on the screen and make smart choices in complex environments.
- Full transparency: Users can review a detailed history of agent activity, including screenshots and reasoning steps.
The Road Ahead: Early Access and Microsoft Build 2025
Microsoft is inviting organizations to apply for early access to the new feature in Copilot Studio. The company will showcase more about this innovation at Microsoft Build in May 2025, signaling a future where AI-powered agents can automate virtually any digital task, regardless of platform or integration limitations.
Microsoft Copilot Studio’s new capability marks a new era in business automation, making UI automation smarter, more resilient, and accessible to all. As AI continues to transform enterprise workflows, Copilot Studio can help organizations streamline operations, boost productivity, and drive innovation across every industry.
About The Author
Discover more from Microsoft News Now
Subscribe to get the latest posts sent to your email.
