The tech industry continues to push the boundaries of AI automation, with Microsoft making significant strides in this direction. The company has introduced a groundbreaking ‘computer use’ feature in its Copilot Studio platform, allowing AI agents to interact with websites and applications automatically, much like a human user would.
This development follows OpenAI’s introduction of Operator, an AI agent capable of handling tasks on behalf of users, intensifying competition in the industry. Microsoft’s new feature represents a major leap forward, as it enables AI agents to automate tasks even when there are no built-in integrations or APIs available.
According to Charles Lamanna, a senior leader at Microsoft, the new feature is designed to make AI agents appear like real users, capable of clicking, selecting, and typing information just as a person would. “If a person can use the app, the agent can too,” Lamanna explained, highlighting the feature’s potential to handle tasks without direct API connections.
The ‘computer use’ feature in Copilot Studio has significant implications for businesses, allowing them to create AI agents that can perform tasks such as filling in reports, logging into websites, and handling customer service inquiries. This advancement makes the platform more versatile and capable of automating complex, real-world tasks.
One of the most notable aspects of this feature is its ability to adapt to changing interfaces, leading to more reliable automation. While Microsoft introduced a similar feature called Actions in the past, the ‘computer use’ feature in Copilot Studio appears to be a more sophisticated tool designed for business-level automation.
As tech giants continue to focus on leveraging AI to streamline mundane tasks and improve user experiences, Microsoft’s latest innovation positions the company at the forefront of AI-driven automation.
